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Preface 


Mathematical analysis is a standard course which introduces students to rigorous 
reasonings in mathematics, as well as the theories needed for advanced analysis 
courses. It is a compulsory course for all mathematics majors. It is also strongly 
recommended for students that major in computer science, physics, data science, 
financial analysis, and other areas that require a lot of analytical skills. Some 
standard textbooks in mathematical analysis include the classical one by Apostol 
[Apo74] and Rudin [Rud76], and the modern one by Bartle [BS92], Fitzpatrick 
[Fit09], Abbott [Abb15], Tao [Taol6, Taol4] and Zorich [Zor15, Zor16]. 

This book is the first volume of the textbooks intended for a one-year course in 
mathematical analysis. We introduce the fundamental concepts in a pedagogical 
way. Lots of examples are given to illustrate the theories. We assume that students 
are familiar with the material of calculus such as those in the book [SCW20]. 
Thus, we do not emphasize on the computation techniques. Emphasis is put on 
building up analytical skills through rigorous reasonings. 

Besides calculus, it is also assumed that students have taken introductory 
courses in discrete mathematics and linear algebra, which covers topics such as 
logic, sets, functions, vector spaces, inner products, and quadratic forms. Whenever 
needed, these concepts would be briefly revised. 

In this book, we have defined all the mathematical terms we use carefully. 
While most of the terms have standard definitions, some of the terms may have 
definitions defer from authors to authors. The readers are advised to check the 
definitions of the terms used in this book when they encounter them. This can be 
easily done by using the search function provided by any PDF viewer. The readers 
are also encouraged to fully utilize the hyper-referencing provided. 
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Chapter 1 


The Real Numbers 


1.1 Logic, Sets and Functions 


In this section, we give a brief review of propositional logic, sets and functions. 
It is assumed that students have taken an introductory course which covers these 
topics, such as a course in discrete mathematics [Ros 18]. 


Definition 1.1 Proposition 


A proposition, usually denoted by p, is a declarative sentence that is either 


true or false, but not both. 


Definition 1.2 Negation of a Proposition 


If p is a proposition, —p is the negation of p. The proposition p is true if 
and only if the negation —p is false. 


From two propositions p and g, we can apply logical operators and obtain a 


compound proposition. 


Definition 1.3 Conjunction of Propositions 


If p and q are propositions, p /\ q is the conjunction of p and gq, read as "p 
and q". The proposition p / q is true if and only if both p and q are true. 


Definition 1.4 Disjunction of Propositions 


If p and q are propositions, p V q is the disjunction of p and q, read as "p or 


q". The proposition p V q is true if and only if either p is true or gq is true. 
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Definition 1.5 Implication of Propositions 


If p and q are propositions, the proposition p — q is read as '"p implies q". 


It is false if and only if p is true but q is false. 


p — qcan also be read as "if p then q or "p only if q". In mathematics, we 


usually write p ==> q instead of p > q. 
Definition 1.6 Double Implication 


If p and q are propositions, the proposition p «—> q is read as "p if and 
only if q". It is the conjunction of p — q and q — p. Hence, it is true if and 
only if both p and q are true, or both p and q are false. 


The stament “‘p if and only if q” is often expressed asp <=> q. 

Two compound propositions p and q are said to be logically equivalent, denoted 
by p = q, provided that p is true if and only if q is true. 

Logical equivalences are important for working with mathematical proofs. 
Some equivalences such as commutative law, associative law, distributive law are 
obvious. Other important equivalences are listed in the theorem below. 


Theorem 1.1 Logical Equivalences 


Let p, qg, r be propositions. 
l. pq = -pVq 
2. De Morgan’s Law 


(i) “(pV q) = =p A 7q 
(il) s(p/\q)3= "=p VY og 


A very important equivalence is the equivalence of an implication with its 


contrapositive. 


Theorem 1.2 Contraposition 


If p and q are propositions, p — q is equivalent to ~q — —p. 
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In mathematics, we are often dealing with statements that depend on variables. 


Quantifiers are used to specify the extent to which such a statement is true. Two 


commonly used quantifiers are "for all" (V) and "there exists" (4). 
For negation of statements with quantifiers, we have the following generalized 
De Morgan’s law. 


Theorem 1.3 Generalized De Morgan’s Law 


For nested quantifiers, the ordering is important if different types of quantifiers 


are involved. For example, the statement 


Va sy c+y=0 


is not equivalent to the statement 


dyVe c+y=0. 


When the domains for x and y are both the set of real numbers, the first statement 
is true, while the second statement is false. 
For a set A, we use the notation x € A to denote zx is an element of the set A; 


and the notation x ¢ A to denote x is not an element of A. 


Definition 1.7 Equal Sets 


Two sets A and B are equal if they have the same elements. In logical 
expression, A = B if and only if 


rEA = tresB. 


Definition 1.8 Subset 
If A and B are sets, we say that A is a subset of B, denoted by A C B, 


if every element of A is an element of B. In logical expression, A C B 


means that 
rEA=> cebB. 
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When A is a subset of B, we will also say that A is contained in B, or B 
contains A. 

We say that A is a proper subset of B if A is a subset of B and A # B. In 
some textbooks, the symbol "C" is used to denote subset, and the symbol "Cc" 
is reserved for proper subset. In this book, we will not make such a distinction. 
Whenever we write A C B, it means A is a subset of B, not necessary a proper 
subset. 

There are operations that can be defined on sets, such as union, intersection, 


difference and complement. 


Definition 1.9 Union of Sets 
If A and B are sets, the union of A and B is the set A U B which contains 


all elements that are either in A or in B. In logical expression, 


rE AUB <=> (te A) V (cE B). 


Definition 1.10 Intersection of Sets 
If A and B are sets, the intersection of A and B is the set AM B which 


contains all elements that are in both A and B. In logical expression, 


rEANB <— (@EA) A (cE B). 


Definition 1.11 Difference of Sets 
If A and B are sets, the difference of A and B is the set A \ B which 
contains all elements that are in A and not in B. In logical expression, 


tEA\B <= (ceEA)A (x¢B). 


Definition 1.12 Complement of a Set 


If A is a set that is contained in a universal set U, the complement of A in 
U is the set A° which contains all elements that are in U but not in A. In 


logical expression, 


ce Al => (rx eU) A (cx €¢ A). 
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Since a universal set can vary from context to context, we will usually avoid 
using the notation A© and use U \ A instead for the complement of A in U. The 
advantage of using the notation A® is that De Morgan’s law takes a more succint 
form. 


Proposition 1.4 De Morgan’s Law for Sets 


If A and B are sets in a universal set U, and A© and B® are their 
complements in U, then 


1 (AW B)o =A®P Be 


2 (Arr By = Ao Ur Be 


Definition 1.13 Functions 


When A and B are sets, a function f from A to B, denoted by f : A > B, 
is a correspondence that assigns every element of A a unique element in B. 
If a is in A, the image of a under the function f is denoted by f(a), and it 
is an element of B. 

A is called the domain of f, and B is called the codomain of /. 


Definition 1.14 Image of a Set 


If f : A— Bisa function and C is a subset of A, the image of C’ under f 
is the set 


yO) SNe) iers Cyr 
f(A) is called the range of f. 


Definition 1.15 Preimage of a Set 


If f : A— Bisa function and D is a subset of B, the preimage of D under 
f is the set 


f(D) = {a€ Al f(a) € D}. 


Notice that f~'(D) is a notation, it does not mean that the function f has an 
inverse. 


Next, we turn to discuss injectivity and surjectivity of functions. 
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Definition 1.16 Injection 


We say that a function f : A — B is an injection, or the function f : 


A — B is injective, or the function f : A > B is one-to-one, if no pair of 
distinct elements of A are mapped to the same element of B. Namely, 


a, # a. = > f(a) F f(a). 


Using contrapositive, a function is injective provided that 


ja) = flea) = aq=—ce. 
Definition 1.17 Surjection 


We say that a function f : A > B is asurjection, or the function f : A > 
B is surjective, or the function f : A — B is onto, if every element of B 
is the image of some element in A. Namely, 


Vb € B, Aa € A, f(a) =. 


Equivalently, f : A — B is surjective if the range of f is B. Namely, 
f(A) = B. 


Definition 1.18 Bijection 


We say that a function f : A > B isa bijection, or the function f : A > B 


is bijective, if it is both injective and surjective. 
A bijection is also called a one-to-one correspondence. 


Finally, we would like to make a remark about some notations. If f : A B 
is a function with domain A, and C is a subset of A, the restriction of f to C’ is 
the function f|c : C > B defined by f|c(c) = f(c) for all c € C. When no 
confusion arises, we will often denote this function simply as f : C > B. 
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1.2. The Set of Real Numbers and Its Subsets 


In this section, we introduce the set of real numbers using an intuitive approach. 


Definition 1.19 Natural Numbers 


The set of natural numbers N is the set that contains the counting numbers, 


1,2,3..., which are also called positive integers. 


N is an inductive set. The number | is the smallest element of this set. If n is 
a natural number, then n + 1 is also a natural number. 

The number 0 corresponds to nothing. 

For every positive integer n, —n is a number which produces 0 when adds to 
n. This number —n is called the negative of n, or the additive inverse of n. 


—1, —2, —3,..., are called negative integers. 


Definition 1.20 Integers 


The set of integers Z is the set that contains all positive integers, negative 


integers and 0. 


We will also use the notation Z* to denote the set of positive integers. 
p g 


Definition 1.21 Rational Numbers 


The set of rational numbers (Q is the set defined as 


{=| mneZn 40}. 
n 


Each rational number is a quotient of two integers, where the denominator is 
nonzero. The set of integers Z is a subset of the set of rational numbers Q. 


Every rational number m/n has a decimal expansion. For example, 


7 = 3.857142857142... = 3.857142. 


The decimal expansion of a rational number is either finite or periodic. 
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Definition 1.22 Real Numbers 


The set of real numbers R is intuitively defined to be the set that contains 


all decimal numbers, which is not necessary periodic. 


The set of real numbers contains the set of rational numbers Q as a subset. If 


areal number is not a rational number, we call it an irrational number. The set 


of irrational numbers is R \ Q. 


It has been long known that there are real numbers that are not rational numbers. 
The best example is the number \/2, which appears as the length of the diagonal 
of a unit square (see Figure 1.1). 


Figure 1.1: The number V2. 


The addition and multiplication operations defined on the set of natural numbers 
can be extended to the set of real numbers consistently. 

If a and b are real numbers, a + b is the addition of a and 6, and ab is the 
multiplication of a and b. 

If a and b are positive real numbers, a+b and ab are also positive real numbers. 

The set of real numbers with the addition and multuplication operations is 
a field, which you will learn in abstract algebra. These operations satisfy the 
following properties. 
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Properties of Real Numbers 


. Commutativity of Addition 


a+b=b+a 


. Associativity of Addition 


(a+b)+c=a+(b+c) 


. Additive Identity 
at+0=0+a=a 


0 is called the additive identity. 


. Additive Inverse 
For every real number a, the negative of a, denoted by —a, satisfies 


. Commutativity of Multiplication 


ab = ba 


. Associativity of Multiplication 


(ab)c = a(bc) 


. Multiplicative Identity 


1 is called the multiplicative identity. 


. Multiplicative Inverse 


For every nonzero real number a, the reciprocal of a, denoted by 1/a, 


satisfies 


. Distributivity 
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The set of complex numbers C is the set that contains all numbers of the 
form a + 7b, where a and b are real numbers, and 7 is the purely imaginary 


number such that 72 = —1. It contains the set of real numbers R as a subset. 


Addition and multiplication can be extended to the set of complex numbers. These 
two operations on complex numbers also satisfy all the properties listed above. 
Nevertheless, we shall focus on the set of real numbers in this course. 

There are special subsets of real numbers which are called intervals. There 
are nine types of intervals, four types are finite, five types are semi-infinite or 
infinite. Their definitions are as follows. 


Finite Intervals 


la(@,b)= {7 eR\|a= 7 <b} 


2. (eo {e eR laa 2 <b} 


3. (a,b = {ee R| a < 2b} 


4, [a,b] ={x €R|a<az <b} 


For the intervals (a, b), [a, b), (a, 0], [a,b], the points a and b are the end points 
of the interval, while any point x with a < x < bis an interior point. 


Semi-Infinite or Infinite Intervals 


For the intervals (a, 00), [a, 00), (—oo, a) and (—oo, a], a is the end point of 


the interval, while any other points in the interval besides a is an interior point. 
The set of natural numbers is a well-ordered set. Every nonempty subset 
of positive integers has a smallest element. This statement is equivalent to the 
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principle of mathematical induction, which is one of the important strategies in 


proving mathematical statements. 


Proposition 1.5 Principle of Mathematical Induction 


Let P(n) be a sequence of statements that are indexed by the set of positive 


integers Z*. Assume that the following two assertions are true. 
1. The statement P(1) is true. 


2. For every positive integer n, if the statement P(n) is true, the statement 
P(n + 1) is also true. 


Then we can conclude that for all positive integers n, the statement P(n) is 
true. 


Before ending this section, let us discuss the absolute value and some useful 
inequalities. 
Definition 1.23, Absolute Value 


Given a real number z, the absolute value of x, denoted by ||, is defined 
to be the nonnegative number 


if x > 0, 
Jz] = 


In particular, | — x| = |z]. 


For example, |2.7| = 2.7, | — 2.7| = 2.7. 

The absolute value |x| can be interpreted as the distance between the number 
x and the number 0 on the number line. For any two real numbers x and y, |x — y| 
is the distance between x and y. Hence, the absolute value can be used to express 
an interval. 
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Intervals Defined by Absolute Values 


Let a be a real number. 


1. If r is a positive number, 


jn-al<r = -r<u-a<r = rée(a-r,atr). 


2. If r is a nonnegative number, 


jn -—al <r = -r<a-a<r = réla—-r,atr]. 


Absolute values behave well with respect to multiplication operation. 


Proposition 1.6 


Given real numbers x and y, 


|zy| = |x||yI. 


In general, |x + y| is not equal to |x| + |y|. Instead, we have an inequality, 
known as the triangle inequality, which is very important in analysis. 


Proposition 1.7 Triangle Inequality 


Given real numbers x and y, 


ese eS lal Se ele 


This is proved by discussing all four possible cases where x > 0 or x < 0, 
y>O0ory <0. 

A common mistake students tend to make is to replace both plus signs in the 
triangle equality directly by minus signs. This is totally assurd. The correct one is 


|x — y| < |z|+|—y| = [2] +4 lyl. 


For the inequality in the other direction, we have 
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Proposition 1.8 


Given real numbers x and y, 


jz — y| 2 [la] — Iyll. 


Since |x — y| > 0, the statement is equivalent to 
—|a—yl Sle] —lyl Sle — yl. 
By triangle inequality, 
ai ae (ell 22 | ae al = |e 


Hence, 
|x| — |y| < |e —y. 


By triangle inequality again, 


ae elfen ease [eee ie toe | (L 


Hence, 
| |S eo ie 


This completes the proof. 


Example 1.1 


If | — 5| < 2, show that 
ae 2) 


Solution 
|x — 5| < 2 implies 3 < x < 7. This means that x is positive. The 
inequality x > 3 then implies that x? > 9, and the inequality x < 7 implies 
that x? < 49. Therefore, 
9< 2? < 49. 


Finally, we have the useful Cauchy’s inequality. 
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Proposition 1.9 Cauchy’s Inequality 


For any real numbers a and b, 


Proof 


This is just a consequence of (a — b)? > 0. 


An immediate consequence of Cauchy’s inequality is the arithmetic mean- 


geometric mean inequality. For any nonnegative numbers a and b, the geometric 


. . : . a 
mean of a and 6 is ab, and the arithmetic mean is 


Proposition 1.10 


Ifa > 0, b > 0, then 
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Exercises 1.2 


Question 1 


Use induction to show that for any positive integer n, 
i aes 
Question 2: Bernoulli’s Inequality 
Given that a > —1, use induction to show that 
(1+a)”>l+na 
for all positive integer n. 


Question 3 


Let n be a positive integer. If c,,c2,...,C, are numbers that lie in the 
interval (0, 1), show that 


(1—c)(1—e2)...(l—en) > l—e1 — eg — +--+ — 
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1.3. Bounded Sets and the Completeness Axiom 


In this section, we discuss a property of real numbers called completeness. The 
set of rational numbers does not have this property. 

First, we introduce the concept of boundedness. 

Definition 1.24 Boundedness 

Let S be a subset of R. 


1. We say that S is bounded above if there is a number c such that 


a<ec forallzeS. 
Such a c is called an upper bound of S. 
. We say that S is bounded below if there is a number b such that 
z>b forallzesS. 
Such a b is called a lower bound of S. 


. We say that S is bounded if it is bounded above and bounded below. In 
this case, there is anumber such that 


lz) << M forallze S. 


Let us look at some examples. 


Example 1.2 


Determine whether each of the following sets of real numbers is bounded 
above, whether it is bounded below, and whether it is bounded. 


(a) A={a|a < 2} 


(b) B={z|z>—-2} 


(CC = {e297 <2) 
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Solution 
(a) The set A is bounded above since every element of A is less than or 


equal to 2. It is not bounded below, and so it is not bounded. 


(b) The set B is bounded below since every element of B is larger than or 
equal to —2. It is not bounded above, and so it is not bounded. 


(c) The set Cis equal to ANB. So it is bounded above and bounded below. 
Therefore, it is bounded. 


ms . S$ Dh 
Z 


(a) A={x|x<2}3 


(b) B={x|x>-2} 


ey 
a) 2 


(c) C={x|-2<x<2} 


Figure 1.2: The sets A, B, C in Example 1.2. 
If S is a set of real numbers, the negative of S, denoted by —S, is the set 
—-S={-z|xreS}. 


For example, the set B = {x |x > —2} is the negative of the set A = {x |x < 2}, 
the set C = {x| —2 <a < 2} is the negative of itself (see Figure 1.2). It is 
obvious that S' is bounded above if and only if —S' is bounded below. 


Next, we recall the definition of maximum and minimum of a set. 
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Definition 1.25 Maximum and Minimum 


Let S be a nonempty subset of real numbers. 


1. A number c is called the largest element or maximum of S if c is an 
element of S and 
<< E foralla € S. 


If the maximum of the set S exists, we denote is by max S. 


. A number 0 is called the smallest element or minimum of S if 5 is an 
element of S and 
GO forallz € S. 


If the minimum of the set S exists, we denote it by min S. 


Obviously, b is the maximum of a set S' if and only if —b is the minimum of 
the set —S. 


Example 1.3 


For the set S; = [—2, 2], —2 is the minimum, and 2 is the maximum. 


For the set Sy = [—2, 2), —2 is the minimum, and there is no maximum. 


This example shows that a bounded set does not necessarily have maximum 


or minimum. However, a finite set always have a maximum and a minimum. 


Proposition 1.11 


If S is a finite set, then S has a maximum and a minimum. 


Next, we introduce the concept of least upper bound. 
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Definition 1.26 Least Upper Bound 


Let S be a nonempty subset of real numbers that is bounded above, and 


let Us be the set of upper bounds of S. Then Us is a nonempty set that is 


bounded below. If Us has a smallest element u, we say that u is the least 
upper bound or supremum of S, and denote it by 


u = sup 5. 


Example 1.4 


For the sets S; = [—2, 2] and Sy = [—2, 2), 


sup 51 = sup S2 = 2. 


Notice that sup S, if exists, is not necessary an element of S. The following 
proposition depicts the relation between the maximum of a set (if exists) and its 
least upper bound. 


Proposition 1.12 Supremum and Maximum 


Let S be a nonempty subset of real numbers. Then S has a maximum if and 
only if S is bounded above and sup S is in S. 


One natural question to ask is, if S is a nonempty subset of real numbers that 
is bounded above, does S necessarily have a least upper bound. The completeness 
axiom asserts that this is true. 


Completeness Axiom 


If S is a nonempty subset of real numbers that is bounded above, then S 


has a least upper bound. 


The reason this is formulated as an axiom is we cannot prove this from our 
intuitive definition of real numbers. Therefore, we will assume this as a fact for 
the set of real numbers. A lots of theorems that we are going to derive later is a 
consequence of this axiom. 


Actually, the set of real numbers can be constructed axiomatically, taken it 
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to be a set that contains the set of rational numbers, satisfying all properties 
of addition and multiplication operations, as well as the completeness axiom. 
However, this is a tedious construction and will drift us too far. 

To show that the completeness axiom is not completely trivial, we show in 
Example 1.6 that if we only consider the set of rational numbers, we can find a 
subset of rational numbers A that is bounded above but does not have a least upper 
bound in the set of rational numbers. We look at the following example first. 


Example 1.5 


Define the set of real numbers S' by 


Sane Rim. 2h 


Show that S is nonempty and is bounded above. Conclude that the set 
A= {re Q|a? < 2} 


is also nonempty and is bounded above by a rational number. 


Solution 
The number | is in S, and so S is nonempty. For any x € S, 7? < 2 < 4, 
and hence x < 2. This shows that S is bounded above by 2. Since | and 2 
are rational numbers, the same reasoning shows that the set A is nonempty 
and is bounded above by a rational number. 


Example 1.6 


Consider the set 
A= {rE Qa’? <2}. 


By Example 1.5, A is a nonempty subset of rational numbers that is 
bounded above by 2. Let U4 be the set of upper bounds of A in Q. Namely, 


Us ={c€ Q\a < cforall x € A}. 


Show that U, does not have a smallest element. 
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Solution 
We use proof by contradiction. Assume that U4 has a smallest element c,, 
which is an upper bound of A that is smaller than or equal to any upper 
bound of A. Then for any x € A, 


eee 


Since 1 is in A, c, is a positive rational number. Hence, there are poitive 
integers p and q such that 
_?P 
Cj = = 
qd 
Since there are no rational numbers whose square is 2, we must have either 
Gre On Cree 


Define the positive rational number cz by 
foes 2p + 2q 
p+ 2g" 


Notice that 


_ p(p+2q) —9@(2p+2q) _ p? — 2¢? 
(Ci, — (ey = = 


q(p + 2q) q(p + 2q)’ 


eae 


Ci @? 5 


_ 4p? + 8pq + 4q° — 2(p? + 4pq + 4q7) _ 2(p* — 2¢7) 


Cc — 2 ; 
: (p + 2q)? (p + 2q)? 


Case 1: c? < 2. 

In this case, p? < 2q?. It follows that c; < cy and c} < 2. But then cy 
and c, are both in A, and cz is an element in A that is larger than c,;, which 
contradicts to c; is an upper bound of A. Hence, we cannot have c? < 2. 
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Case 2: c7 > 2. 
In this case, p? > 2q?. It follows that c, > cy and c3 > 2. Since c} > 2, we 
find that for any x € A, 


Be Ue 


Thus, 


—C2 <X< Co. 


In particular, cy is also an upper bound of A. Namely, c2 is in U4. But then 
Cc; and Cc» are both in Uy and c, > cy. This contradicts to c, is the smallest 
element in U,. Hence, we cannot have Cs > 2. 

Since both Case | and Case 2 lead to contradictions, we conclude that U4 
does not have a smallest element. 


In the solution above, the construction of the positive rational number cz seems 
a bit adhoc. In fact, we can define c by 


_ mp + 2nq 
np + mq 


for any positive integers m and n with m? > 2n?. Then the proof still works. 
Now let us see how completeness axiom is used to guarantee that there is a 
real number whose square is 2. 


Example 1.7 


Use completeness axiom to show that there is a positive real number c such 
that 


C= 2. 


Solution 
Define the set of real numbers S' by 


S—={7eR a 2 


Example 1.5 asserts that S is a nonempty subset of real numbers that is 
bounded above. Completeness axiom asserts that S has a least upper bound 
ce 
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Since 1 is in S, c > 1. We are going to prove that c? = 2 using proof by 
contradiction. If c? # 2, then c? < 2 orc? > 2. 

Case 1: c? < 2. 

Let d = 2 — c’. Then 0 < d < 1. Define the number c, by 


Cc See 
oa Ac 


Then c, > c, and 


Z 
= 


This implies that c; is an element of S that is larger than c, which contradicts 
to cis an upper bound of S. 

Case 2: c? > 2. 

Let d = c? — 2. Then d > 0. Define the number c; by 


Then c; < c, and 


This implies that c, is an upper bound of S' that is smaller than c, which 
contradicts to c is the least upper bound of S. 
Since we obtain a contradiction if c? 4 2, we must have c? = 2. 


In fact, the completeness axiom can be used to show that for any positive real 


number a, there is a positive real number c such that 
C=a. 


We denote this number c as \/a, called the positive square root of a. The number 
b = —\/a is another real number such that b? = a. 

More generally, if n is a positive integer, a is a positive real number, then there 
is a positive real number c such that c” = a. We denote this number c by 


C= a, 
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called the positive n'-root of a. 
Using the interplay between a set and its negative, we can define the greatest 


lower bound of a set that is bounded below. 


Definition 1.27 Greatest Lower Bound 


Let S be a nonempty subset of real numbers that is bounded below, and 


let Ls be the set of lower bounds of S. Then Lg is a nonempty set that is 
bounded above. If Lg has a largest element /, we say that @ is the greatest 
lower bound or infimum of S, and denote it by 


€=int S. 


From the completeness axiom, we have the following. 


Theorem 1.13 


If S is a nonempty subset of real numbers that is bounded below, then S 
has a greatest lower bound. 


For a nonempty set S that is bounded, it has a least upper bound sup S and a 


greatest lower bound inf 5S. The following is quite obvious. 


Proposition 1.14 


If S is a bounded nonempty subset of real numbers, it has a least upper 
bound sup S and a greatest lower bound inf S. Moreover, 


inf S < sups, 


and inf S = sup S if and only if S contains exactly one element. 


Let us emphasize again the characterization of the least upper bound and 


greatest lower bound of a set. 
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Characterization of Supremum and Infimum 


Let S be a nonempty subset of real numbers, and let a be a real number. 
1. a=sup S if and only if the following two conditions are satisfied. 
Gi) Foralla € S,x2 <a. 
(ii) If bis areal number such that x < 6 for all x € S, then a < b. 


2. a = inf S if and only if the following two conditions are satisfied. 


Gi) Foralla € S,x7> a. 


(ii) If bis areal number such that x > 6 for all x € S, then a > b. 


Example 1.8 


For each of the following set of real numbers, determine whether it has a 
least upper bound, and whether it has a greatest lower bound. 


(a) A= {ar eR a> = 2} 


(b) B= {rz €R|a? < 10}. 


Solution 


(a) The set A is bounded above, since if x € A, then 7° < 2 < 23, and so 
x < 2. The set A is not bounded below since it contains all negative 
numbers. Hence, A has a least upper bound, but it does not have a 
greatest lower bound. 


(b) If x? < 10, then x? < 16, and so —4 < x < 4. This shows that B 
is bounded. Hence, B has a least upper bound, and a greatest lower 
bound. 


Finally, we want to highlight again Proposition 1.12 together with its lower 
bound versus infimum counterpart. 
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Existence of Maximum and Minimum 
Let S be a nonempty subset of real numbers. 


1. S has a maximum if and only if S is bounded above and sup S is in S. 


2. S has a minimum if and only if Sis bounded below and inf S is in S. 
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Exercises 1.3 


Question 1 


For each of the following sets of real numbers, find its least upper bound, 
greatest lower bound, maximum, and minimum if any of these exists. If 


any of these does not exist, explain why. 
(a) A = (—oo, 20) 

(b) B = [-38, co) 

(c) C = [—10, —2) U(1, 12] 

(d) D = [-2,5]N (-1, 7] 


Question 2 
Use completeness axiom to show that there is a positive real number c such 
that 
2 = 5. 
Question 3 
For each of the following set of real numbers, determine whether it has a 


least upper bound, and whether it has a greatest lower bound. 


(a) A= {x E R|2° > 10} 


(b) B= {x € R| a? < 2020}. 
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1.4 Distributions of Numbers 


In this section, we consider additional properties of the set of integers, rational 
numbers and real numbers. 


We start by a proposition about distribution of integers. 
Proposition 1.15 
1. If n is an integer, there is no integer in the interval (n,n + 1). 


2. For any real number c, there is exactly one integer in the interval [c, c + 


1), and there is exactly one integer in the interval (c, c + 1]. 


These statements are quite obvious. For any real number c, the integer in the 
interval |c,c+1) is [c], called the ceiling of c. It is the smallest integer larger than 
or equal to c. For example [—2.5] = —2, |—3] = —3. The integer in the interval 
(c,c + 1] is [c| +1, where |c| is the floor of c. It is the largest integer that is less 
than or equal to c. For example, |—2.5| = —3, |—3] = —3. 

In Section 1.3, we have seen that a nonempty subset of real numbers that 
is bounded above does not necessary have a maximum. Example 1.6 shows 
that a nonempty subset of rational numbers that is bounded above also does not 
necessary have a maximum. However, for nonempty subsets of integers, the same 


is not true. 


Proposition 1.16 


Let S be a nonempty subset of integers. 


1. If S is bounded above, it has a maximum. 


2. If S is bounded below, it has a minimum. 


The two statements are equivalent, and the second statement is a generalization 
of the well-ordered principle for the set of positive integers. It can be proved using 
mathematical induction. 

Next we discuss another important property called the Archimedean property. 
First let us show that the set of positive integers Z* is not bounded above. 
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Theorem 1.17 


The set of positive integers Z* is not bounded above. 


Assume to the contrary that the set of positive integers Z* is bounded 


above. By completeness axiom, it has a least upper bound wu. Since 
u—1 <u, u-—1is not an upper bound of Z*. Hence, there is a positive 
integer n such that 

fea 


It follows that 
n+1>u. 


Since n + | is also a positive integer, this says that there is an element of 
Z* that is larger than the least upper bound of Z*. This contradicts to the 
definition of least upper bound. Hence, Z* cannot be bounded above. 


The proof uses the key fact that any number that is smaller than the least upper 
bound of a set is not an upper bound of the set. This is a standard technique in 


proofs. 


Theorem 1.18 The Archimedean Property 


1. For any positive number /, there is a positive integer n such that n > 
M. 


2. For any positive number ¢, there is a positive integer n such that 1/n < 
é. 


These two statements are equivalent, and the first statement is equivalent to 
the fact that the set of positive integers is not bounded above. 
In the following, we consider another property called denseness. 


Definition 1.28 Denseness 


Let S' be a subset of real numbers. We say that S is dense in R if every 


open interval (a, b) contains an element of S. 
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A key fact we want to prove is that the set of rational numbers Q is dense in 
the set of real numbers. 


Theorem 1.19 Denseness of the Set of Rational Numbers 


The set of rational numbers Q is dense in the set of real numbers R. 


Let (a,b) be an open interval. Then « = b— a > 0. By the Archimedean 


property, there is a positive integer n such that 1/n < ¢. Hence, 


nb—na=ne > 1, 
and so 
na+1<nb. 
Consider the interval (na,na + 1]. There is an integer m that lies in this 
interval. In other words, 
na<m<nat+1< nb. 
Dividing by n, we have 
m 
oa = 
n 


This proves that the open interval (a, b) contains the rational number m/n, 
and thus completes the proof that the set of rational numbers is dense in the 


set of real numbers. 


Recall that a set A is said to be countably infinite if there is a bijection f : 
Z* —» A. A set that is either finite or countably infinite is said to be countable. 
We assume that students have seen the proofs of the following. 


Proposition 1.20 


The set of integers Z and the set of rational numbers Q are countable, while 


the set of real numbers R is not countable. 


Since the union of countable sets is countable, this proposition implies that the 


set of irrational numbers is uncountable. Therefore, there are far more irrational 
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numbers than rational numbers. Hence, it should not be surprising that the set of 
irrational numbers is also dense in the set of real numbers. To prove this, let us 
recall the following facts. 


Rational Numbers and Irrational Numbers 


1. If a and b are rational numbers, then a + 6 and ab are rational numbers. 


2. If ais a nonzero rational number, 6 is an irrational number, then ad is an 


irrational number. 


Theorem 1.21 Denseness of the Set of Irrational Numbers 


The set of irrational numbers R \ Q is dense in the set of real numbers R. 


Let (a,b) be an open interval. Define 


Then c < d. By the denseness of rational numbers, there is a rational 
number u that lies in the interval (c, d). Hence, 


b 
=@e<u<d= 


v2 v2 


Let v = V2u. Then v is an irrational number satisfying 


a<u<b. 


This proves that the open interval (a, b) contains the irrational number v, 
and thus completes the proof that the set of irrational numbers is dense in 
the set of real numbers. 


Example 1.9 


Is the set of integers Z dense in R? Justify your answer. 
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Solution 


(0, 1) is an open interval that does not contain any integers. Hence, the set 


of integers is not dense in R. 


Exercises 1.4 


Question 1 


Let S = Q\ Z. Is the set S dense in R? Justify your answer. 
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1.5 The Convergence of Sequences 


Infinite sequences play important roles in analysis. We will consider infinite 
sequences that are indexed by the set of positive integers 


Q1,92,.--,Qn,--. 


This can be considered as a function f : Zt — R, where a, = f(n). The general 
term in the sequence is denoted by a,,. In some occasions, we may also want to 
consider sequences that start with ao. 

In the sequel, when we say a sequence, we always mean an infinite sequence 
that is indexed by the set of positive integers, unless otherwise specified. A 
sequence can be denoted by {a,,} or {a,, }°@,. This should not be confused with 
the set {a,,|n € Z*} that contains all terms in the sequence. 

There are various ways to specify a sequence. One of the ways is to give an 
explicit formula for the general term a,,. For example {1/n} is the sequence with 
An = 1/n. More precisely, it is the sequence with first five terms given by 


A sequence can also be defined recursively, such as the following example. 


Example 1.10 


Let {a,,} be the sequence defined by a, = 2, and for n > 2, 


Gp, = Oy ae we 


Find the first 5 terms of the sequence. 


Solution 
We compute recursively. 
Gy =? 
a2 =a, + 2 =5 
a3 = ag+ 318 
Q4=a3+3=11 
G2 = 64-25 = 14 
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The sequence {a,,} in Example 1.10 is an example of an arithmetic sequence. 
One can prove by induction that 


An = 38n—1. 


Example 1.11 


Let {s,,} be the sequence defined by s; = *, and for n > 2, 


1 
Sin = Spoil ar A 


Find the first 5 terms of the sequence. 


Solution 
We compute recursively. 


The sequence {s,,} in Example 1.11 is the partial sum of the geometric sequence 


{ met One can prove by induction that 
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Example 1.12 


Let {s,,} be the sequence defined by 


This sequence can also be defined recursively by s; = 1, and for n > 2, 


Sy = Sn-1 + —- 
nm 


For the sequence {s,,} defined in Example 1.12, the general term s,, cannot be 
expressed as an explicit elementary function of n. 


Example 1.13 
Let {a,,} be the sequence defined by a; = 2, and for n > 1, 


On ++ ifa, < 3, 


An+1 = 
Gn — + ian 3. 


Find the first six terms of the sequence. 


Solution 
We compute recursively. 


Oi =2<3 
Oy =O Pp lS=seSs 


From the examples above, we observe that some sequences are monotone. 
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Definition 1.29 Increasing and Decreasing Sequences 
1. We say that a sequence {a,,} is increasing if 


Gy Sea for alln € Zr. 


2. We say that a sequence is decreasing if 


Ghee for alln € ZT. 


3. We say that a sequence {a,,} is monotone if it is an increasing sequence 


or it is a decreasing sequence. 
Example 1.14 
1. The sequence {a,,} defined in Example 1.10 is increasing. 
ial : 
2. The sequence taf is decreasing. 
n 


3. The sequence {a,,} defined in Example 1.13 is neither increasing nor 
decreasing. 


In analysis, we are often led to consider the behavior of a sequence {a,,} when 
n gets larger than larger. We are interested to know whether the sequence would 
approach a fixed value. This leads to the idea of convergence. 


Definition 1.30 Convergence of Sequences 


A sequence {a,,} is said to converge to the number a if for every positive 
number ¢, there is a positive integer NV such that for all n > N, 


lan — al <e. 


Here the positive number ¢ is used to measure the distance from the term a, 
to the number a. Since < can be any positive number, the distance can get as small 
as possible. 

One question that is natural to ask is whether a sequence {a,,} can converge to 
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a-—e€e a Qn até 
Figure 1.3: |a, —a| <. 


two different numbers. This is impossible. 


Theorem 1.22 


A sequence cannot converge to two different numbers. 


This is proved by contradiction. Assume that there is a sequence {a,,} 
which converges to two different numbers b and c. Let 


lb=<c| 
ae 


Since b and c are distinct, |b — c| > 0 and soe > 0. By definition of 
convergence, there is a positive integer ; such that for all n > Nj, 


lan — b| <e. 
Similarly, there is a positive integer N> such that for alln > No, 


lan — cl] <e. 


If N = max{ Nj, No}, then N > N; and N > Np. It follows that 


|b — c| = |(an — c) — (an — B)| < Jan — cl + lan — 6] <e +e = |b-cl. 


This gives |b — c| < |b — c|, which is a contradiction. Hence, we conclude 
that a sequence cannot converge to two different numbers. 
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b-—ée b ore c cte 
Figure 1.4: A sequence {a,,} cannot converge to two different numbers b and c. 


Limit of a Sequence 


If a sequence {a,,} converges to a number a, we say that the sequence is 


convergent. Otherwise, we say that it is divergent. Theorem 1.22 says 
that for a convergent sequence {a,,}, the number a that it converges to is 
unique. We call this unique number a the limit of the convergent sequence 
{a,}, and express the convergence of {a,,} to a as 


lim d= a. 
N—-0o 


Using logical expression, 


lma@a,=a <— > Ve>0, IN €Z*, Vn>N, |a,—al <e. 


N—->Co 


Let us look at a simple example of a constant sequence. 


Example 1.15 


Let c be a real number and let {a,,} be the sequence with a, = c for all 
n € Z*. Then for any € > 0, we take N = 1. Foralln > N = 1, we have 


lan — c| = |c-—c] =O <e, 


which shows that the limit of the constant sequence {a,,} is c. Namely, 


lim ¢=c¢. 
N—- oo 


- 
Another simple example is the sequence {a,,} with a, = —. 
n 
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Example 1.16 
Use the definition of convergence to show that 


1 
hia, = = (0), 
no N 


Solution 


Given ¢ > O, the Archimedean property asserts that there is a positive 
integer N such that 1/N < ¢. Ifn > N, we have 


i) 


O< =< = 
— N 


1 
= < ee 
n 

This gives 


1 
+ =o] <e foralln > N. 
n 


By definition, we conclude that 


lim — = 0. 
noo 1 


Let f : Z* + Z* be a function satisfying 
f(k) < f(k+1) for all k € Z*. 
Then f(Z*) is an infinite set of positive integers. If we let n, = f(k), then 
my <ng<ng<-r-. 
Namely, 1, 22, 23, ... 18 a strictly increasing sequence of positive integers. 


Definition 1.31 Subsequence 


Let {a,} be a sequence. A subsequence of {a,,} is a sequence {a,,,} 
indexed by k € Z*, where n, = f(k) is defined by a function f : Zt > Zt 
satisfying 


f(k) < f(k+1) for all k € Z*. 
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Example 1.17 


The sequence {1/(2n — 1)} with first three terms given by 


| 
co 
is a subsequence of the sequence {1/n} whose first five terms are 
1 
a 


If a sequence {a,,} converges to a, what can we say about its subsequence? It 
is natural to expect any subsequence of {a,,} also converges to a. 


Theorem 1.23 Subsequence of a Convergent Sequence 


If the sequence {a,,} converges to a, then any of its subsequence also 


converges to a. 


Let {a,,, } be a subsequence of {a,,}. Notice that for all k € Zt, 
Nh > k. 
Given ¢ > 0, there is a positive integer N such that for alln > N, 
lan — al <e. 
Take K = N. Then forallk > K,n, > ng =nyn > N, and thus, 


lan, — al <. 


This proves that {a,,, } indeed converges to a. 
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Example 1.18 


Find the limit 


if it exists. 


Solution 


1 1) 
Notice that is} is a subsequence of ix} with n, = 2". By Example 
& n 
116: 
1 


lim — =0. 
noo N 


We conclude from Theorem 1.23 that 


Example 1.19 


Show that the sequence {(—1)”} is divergent. 


Solution 
Let a, = (—1)”. Then for any positive integer n, a2,_1 = —1, and ag, = 1. 
The subsequence {a2,_1} of {a,,} converges to —1, while the subsequence 
{d2n} of {an} converges to 1. Since there are two subsequences of {a,} 


that converge to two different limits, by Theorem 1.23, the sequence {a,,} 


is not convergent. 


For the sequence {a,, } defined in Example 1.10, we can see that the set {a,,|n € 
Z*} is not bounded above. Therefore, we would expect that the sequence does 
not converge to any number. 

For simplicity, we say that a sequence {a,,} is bounded above/bounded below/ 
bounded if the set {a,, | € Z*} is bounded above/bounded below/bounded . If 
the sequence {a,,} is bounded above, we denote the supremum of the set {a,, |n € 
Z*\ as sup{a,}. If the sequence {a,,} is bounded below, we denote the infimum 
of the set {a, |n € Zt} as inf{a,}. 

We have the following theorem which guarantees that a convergent sequence 
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must be bounded. 


Theorem 1.24 Boundedness of Convergent Sequence 


If a sequence {a,,} is convergent, then it is bounded. Equivalently, if a 
sequence {a,,} is not bounded, then it is not convergent. 


Let {a,} be a convergent sequence that converges to the limit a. By 


definition of convergence with ¢ = 1, there is a positive integer N such 
that for alln > N, 
lan — al <1. 


This implies that 
lan| < lan — a] + |a| < 1+ Ia for alln > N. 
Define 
M = max {|aj|, |aa|,..., |an—i|, la] + 1}. 


Then 
lan| < M for alln € ZT. 


This shows that the sequence {a,,} is bounded. 


Example 1.20 


By Theorem 1.24, the sequence {a,,} defined in Example 1.10 is not 


convergent. 


If the sequence {a,,} is convergent, and c is a constant, it is natural to expect 
that the sequence {ca,,} is also convergent. 


Proposition 1.25 


If the sequence {a,,} converges to a, then the sequence {ca,,} converges to 


ca. 
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Given € > 0, the number 
€ 


lel +1 
is also positive. Since {a,,} converges to a, there is a positive integer N 
such that for alln > N, 


gy= 


E 
lc| +1 


la, —al <e, = 


It follows that for all n > N, 
c 
|can — ca| = |clla, — al < id Be. 
é 


This proves that {ca,,} converges to ca. 


Example 1.21 
By Proposition 1.25, we find that for any constant c, 


. € 
hia. — = (0), 
nooo N 


In the following, we establish a comparison theorem for limits. 


Theorem 1.26 Squeeze Theorem 


Let {a,}, {b,} and {c, } be three sequences. Assume that there is a positive 
integer No such that for all n > No, 


VSO eS ee 


If both the sequences {b,,} and {c,,} converge to @, then the sequence {a,,} 


also converges to @. 
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For a positive number ¢, since the sequence {b,,} converges to @, there is a 
positive integer Nj, such that for alln > Nj, 


lb, — €| <e. 
This implies that for alln > Nj, 
b, —£>—-e. 


Similarly, since the sequence {c,,} converges to @, there is a positive integer 
Np» such that for all n > No, 


ICn — €| <e. 
This implies that for all n > No, 


Cn —&€ <E. 


Let N = max{No, Ni, No}. Ifn > Nin > No, n > Ni andn > No. 
Therefore, ifn > N, 


La ee 


and 
An —€ <n —€ <e. 


This proves that for alln > N, 
lan —&| <e. 


Therefore, the sequence {a,,} converges to @. 


When applying the squeeze theorem, we are interested in the limit of the 
sequence {a,,}. It is not enough to find two seqeunces {b,,} and {c,,} satisfying 


for all n greater than or equal to a fixed No. The two sequences {b,,} and {c,} 


must have the same limit. 
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Example 1.22 


For the sequence {a,,} with 


we have 


Since 


we have 


By squeeze theorem, 


More generally, we have the following. 


Theorem 1.27 


The sequence {a,} converges to 0 if and only if the sequence {|a,|} 
converges to 0. 


A word of caution. If the sequence {|a,,|} is convergent, the sequence {a,,} is 
not necessarily convergent. An example is the sequence {a,,} with a, = (—1)”. 
Theorem 1.27 asserts that if {|a,,|} converges to 0, then {a,,} is convergent, and 
it converges to 0. Nevertheless, if the sequence {a,,} is convergent, the sequence 
{|a,|} is necessarily convergent (see Question 1.5.4). 


Proof of Theorem 1.27 
First assume that the sequence {a,,} converges to 0. Given < > 0, there is a 
positive integer N such that for alln > N, 


lan — O| <e. 
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Notice that 


| lan] —O| = lan] =| @n — 0]. 


Hence, for alln > N, 
| lan| — 0 | <e. 


This proves that the sequence {|a,,|} converges to 0. 
Next, we assume that the sequence {|a,|} converges to 0. Then the 
sequence {—|a,,|} also converges to 0. Since 


—|a,,| = an << laze 


squeeze theorem implies that the sequence {a,,} converges to 0. 


In the following, we discuss two useful results that can be deduced from 
specific information about a convergent sequence. They will be useful in the 
proofs of other theorems that we are going to discuss. 


Lemma 1.28 Sequence with Positive Limit 


If {a,,} is a sequence that converge to a positive number a, there is a positive 
integer NV such that a, > a/2 > 0 foralln > N. 


One can easily formulate a counterpart of this lemma for a sequence with 
negative limit. 


Take « = a/2. Thence > 0. Hence, there is a positive integer N so that for 
alln > N, 
lan — al < 2 


This implies that for alln > N, 


Thus, for alln > N, 
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Lemma 1.29 


. Given that {a,,} is a sequence that is bounded above by c. If {a,} 
converges to a, then a < c. 


. Given that {a,,} is a sequence that is bounded below by b. If {a,} 


converges to a, then a > b. 
. Given that {a,,} is a sequence satifying 


BG Se for alln € ZT. 


If {a,,} converges to a, thenb<a<c. 


It is suffices to prove the first statement. The second statement follows by 
considering the negative of the sequence. The third statement follows by combining 
the results of the first two statements. 


Given that 


line y—c wandenan—¢ wfotallac 2). 
noo 


we want to show that a < c. Assume to the contrary that a > c. Take 
€ =a-—c. Thene > 0. By definition of convergence, there is a positive 
integer N such that for alln > N, 


lan — al <e. 


This implies that 
Qn -a>—-e€=c-a when n > N. 


Hence, 
Gn > € when n > N. 


This contradicts to a,, < c for alln € Z*. Therefore, we must have a < c. 


In Proposition 1.25, we have seen what happens when a convergent sequence 
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is multiplied by a constant. In the following, we inspect the behaviour of limits 
with respect to sums, products and quotients. We start by sums. 


Theorem 1.30 Sums of Convergent Sequences 


If the sequences {a,,} and {b,} converge to a and b respectively, the 
sequence {a,, + b,} converges to a+ b. 


Linearity of Limits of Sequences 
Combining Proposition 1.25 and Theorem 1.30, we obtain the following. If 


him @,— 2, iia 5, = 0B, 
noo noo 


then for any constants a and 6, 


lim (aa, + Bb,) = aa + Bb. 


Proof of Theorem 1.30 
Given a positive number ¢, the number ¢/2 is also positive. Since the 
sequence {a,,} converges to a, there is a positive integer Nj, such that for 
alln > N;, 


E 
lan — al < 7 


Similarly, there is a positive integer N> such that for all n > No, 


, 
n — dl < =. 
ln -B1< 5 


Take N = max{N,,N2}. Then N is a positive integer and N > Ni, 
N > No. If n = N, triangle inequality implies that 
|(@n + bn) — (@ + B)| = |(an — a) + (On — 8)| 
< |@n — a| + [bn — D 
E€ € 
< 3 + 2 
=€. 


This proves that the sequence {a,, + b, } converges to a + b. 
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Now we consider products. 


Theorem 1.31 Products of Convergent Sequences 


If the sequences {a,} and {b,} converge to a and b respectively, the 
sequence {a,,,,} converges to ab. 


Notice that Proposition 1.25 is actually a special case of this theorem when 
{b,,} is a constant sequence. 


Proof of Theorem 1.31 
Since {a,,} and {b,,} are convergent sequences, Theorem 1.24 says that 
each of them is bounded. We can choose a common positive number / so 
that for all n € Z*, 


le ls ae [By l IM 


By Lemma 1.29, 
lal<M, ol <M. 


Now we want to show that the difference of a,,b,, and ab aproaches zero 
when n gets large. This should be achieved by the fact that |a,, — a| and 
|b,, — b| both approach 0 when n gets large. To compare a,,b,, — ab to a, — a 
and b,, — b, we do some manipulations as follows. 


Anby — ab = (dn — a)b, + a(b, — 5). 


It follows from triangle inequality that 


|anbyn — abl < |ay — al|b,| + |a||b, — b] < M (ja, — a] + |b, — b|). 1) 


Now we can show that a,,b,, converges to ab. Given € > 0, since ¢/(2M) is 
also positive, there exists a positive integer N, such that 


when n > Nj. 


Similarly, there exists a positive integer N2 such that 
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S 


i. = 


when n > No. 


Take N = max{N,, No}. Whenn > N,n > N, andn > No. It follows 


from (1.1) that 
E E 
1b G5 +5) = 
lan — bp| < ai + Ti E 
This completes the proof that the sequence {a,,b,} converges to ab. 


For quotient of two sequences, we notice that if y # 0, 


which says that the quotient of x by y is a product of x with the reciprocal of y. 


Hence, it is enough to consider the reciprocal of a nonzero sequence. 


Theorem 1.32 Reciprocal of a Convergent Nonzero Sequence 


If {a,} is a nonzero sequence that converges to a nonzero limit a, the 
reciprocal sequence {1/a,,} converges to 1/a. 


Without loss of generality, assume that a > 0. Lemma 1.28 implies that 
there is a positive integer NV, such that 


an > 5 >0 when n > Nj. 


Given ¢ > 0, a*</2 is also positive. By definition of convergence, there is 


a positive integer Nz such that when n > No, 


Take N = max{Nj, No}. Ifn > N, 


lan —al 2 
2 


al |anllal a 


This proves that the sequence {1/a,,} converges to 1/a. 
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Remark 1.1 Reciprocal of a Sequence That Converges to 0 


In the statement of Theorem 1.32, it is crucial that a # 0. To see this, 
consider the sequence {a,,} with a, = 1/n. It converges to a = 0. The 
sequence {1/a,,} is the sequence of natural numbers {n}, which does not 


converge. In fact, since {a,,} converges to 0, the sequence {1/a,,} is not 


bounded. Hence, the sequence {1/a,,} does not converge. 


Corollary 1.33 Quotients of Convergent Sequences 


Given that {a,,} is a sequence that converges to a, {b,} is a nonzero 
sequence that converges to b. If b 4 0, the sequence {a,,/b,,} converges 
to a/b. 


The results about sums, products and quotients of convergent sequences can 
be summarized in the following. 


Operations on Convergent Sequences 


Given that 


lint 2. =a and limb, = 6: 
nN Co n> co 


1. For any constants a and 3, lim (aa, + 6b,) = aa + Bb. 
N—- Oo 


2. lim anb, = ab. 
n—-oo 


3. Ifb, £0 forall n € Z*+ andb 40, lim ~ 


noo n 


These will be used repeatedly in the future. Let us now look at some examples 
how these properties are applied. 


Example 1.23 


Let m be a positive integer. Product rule of limits implies that 
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Example 1.24 
Determine whether the limit exists. If it exists, find the limit. 


@) im (8+ 359) 


, n+1 
() ea 


ee 
© ae fae |. 


Solution 
(a) Since {1/(3n — 2)} is a subsequence of the sequence {1/n}, it 
converges to 0. By Theorem 1.27, 


—1)r 
inp ) —1()) 
noo 38n — 2 


Hence, 


tim (3+ 5 ) = fim 3+ jim $= 3 +0=3 


n—0o 3n — 2 n—00 noo 3n — 2 

(b) The sequence {2n? + 3n + 4} is not bounded. So it does not have 
a limit. We cannot apply quotient rule of limits directly. Instead, 
we need to do some manipulations. Divide the numerator and the 
denominator by n? and then apply the rules for limits, we have 


2 
2+ tp _2+040_ 2 


7" 
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(c) Divide the numerator and the denominator by n? and then apply the 


rules for limits, we have 


i, 


— + — 

lim ae = lim 2 ne vase 

noo n2 +1 fein 1+0 
Fe 


0. 


(d) Since the reciprocal of the sequence has limit 0 by part (c), we find 
that 


does not exist. 


We have seen in Section 1.3 that the supremum or infimum of a set is not 
necessarily an element of the set. The supremum of a set is an element of the set 
if and only if the set has a maximum. Analogously, the infimum of a set is an 
element of the set if and only if the set has a minimum. 

Even though the supremum and infimum of a set might fail to be an element 
of the set, they are always limits of sequences in that set. 


Lemma 1.34 Supremum and Infimum as Limits 


Let S be a subset of real numbers. 


1. If S is bounded above, there is a sequence {u,,} in S that converges to 
U— sips. 


2. If S is bounded below, there is a sequence {¢,,} in S that converges to 
C= ini, 


Example 1.25 


Consider the set S' = (—oo, 7). It is bounded above with sup S = 7. The 


sequence {u,,} with 


1 
t= = — 
n 


is a sequence in S that converges to 7 = sup S. 
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To prove Lemma 1.34, it suffices for us to prove the first statement. 


Proof of Lemma 1.34 
Assume that S'is bounded above. Then the completeness axiom asserts that 
u = sup S exists. For any positive integer n, u — 1/n is smaller than wu. 
Hence, u — 1/n is not an upper bound of S. This implies that there is an 
element u,, of S such that 


Un >U- —. 
n 


Since u,, is in S and wu is an upper bound of S, we have u,, < u. In other 
words, we have 


1 
PSS eo, Sy for alln € Zr. 
n 


lim ( 
noo 


squeeze theorem implies that 


lim ty, = U. 
nN—- Oo 


This means {w,,} is a sequence in S that converges to wu. 
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Exercises 1.5 


Question 1 


it 
Let a be a positive integer that is larger than 1. Show that lim — = 0. 
noo QQ” 


Question 2 


If {a,,} is a sequence that converge to a negative number a, show that there 
is a positive integer N such that a, < a/2 < 0 foralln > N. 


Question 3 


Determine whether the limit exists. If it exists, find the limit. 


_ 38n+(-1) 
CRT er aria ge 


4n+2 
b) lim ——— 
(b) Hae ey 


Question 4 


If {a,,} is a sequence that converges to a, use the definition of convergence 


to show that the sequence {|a,,|} converges to |a]. 


Question 5: Last Statement in Remark 1.1 


Given that {a,,} is a nonzero sequence that converges to 0. 
(a) Show that {1/a,,} is not bounded. 


(b) Conclude that the sequence {1/a,,} is divergent. 
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Question 6 


Let {a,,} and {b,,} be sequences. Assume that there is a real number a such 
that 
lan — al < by forall n € Z*. 
If lim 0b, = 0, show that 
n—->Cco 
liad. — a. 


n—-co 


Question 7: The Convergence of the Sequence in Example 1.13 
Consider the sequence {a,,} defined in Example by 1.13. It is defined 
recursively by a, = 2, and for n > 1, 
An + 4 iG <3, 
ia, 3 


1 
(a) Show that |an41 — 3| < — forall n € Zt. 
n 
(Hint: Use induction. ] 


(b) Show that the sequence {a,,} is convergent and find its limit. 
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1.6 Closed Sets and Limit Points 


When we study convergence of sequences, we measure the closeness between 
points by a positive number ¢. A point x is within ¢ from the point a if x is in the 
open interval (a — c,a +). More generally, we define a neighbourhood of the 
point a as follows. 


Definition 1.32 Neighbourhood 


Given a is a point in R, a neighbourhood of a is an open interval (b, c) that 


contains a. 


The concept of neighbourhood is closely related to the concept of interior 


point. 


Definition 1.33 Interior Point 


If S is a set of real numbers, and there is a neighbourhood of the point a 


that is contained in S, we call a an interior point of S. 


In this section, we use sequences to define and study some properties of subsets 
of real numbers. Given a subset S of real numbers, we say that a sequence {a,,} 
is in S if each of the terms a,, is a point in S. In other words, the sequence {a,,} 
is in S means that the set {a,,|n € Z*} is a subset of S. We will abuse notation 
and write this as {a,,} C S when there is no confusion. We start with a simple but 


useful lemma. 


Lemma 1.35 


Let S be a subset of real numbers. If {a,,} is a sequence in S that converges 


to a, then every neighbourhood of a contains a point of S. 
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Let (b,c) be a neighbourhood of a. Since a is in (b,c), b < a < c, and 
hence the number 


e = min{a — b,c—a} 


is positive. By definition, a— b > ¢,c—a>e. Since {a,,} converges to a, 


there is a positive integer NV such that for alln > N, 
lan — al <e. 


In particular, 
b<a-e<ayn<ate<e 


This shows that ay is a point in S that is in the neighbourhood (0, c) of a. 


Figure 1.5: b<a<candeé=c—a<a-—vb. 
Next, we revisit the concept of denseness. 


Theorem 1.36 


Let S be a subset of real numbers. Then S' is dense in R if and only if every 


real number ~ is the limit of a sequence in S. 


Since we have proved that each of the set of rational numbers and the set of 
irrational numbers is dense in the set of real numbers, we immediately obtain the 


following. 


Corollary 1.37 


Let xz be a real number. 


1. There is a sequence of rational numbers {p,,} that converges to 2. 


2. There is a sequence of irrational numbers {¢,,} that converges to x. 
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Proof of Theorem 1.36 
First we assume that the set S is dense in R. Given a real number x, we 


want to show that there is a sequence in S that converges to x. For each 


positive integer n, since S is dense in R, there is an element of S' in the 
open interval (a2 — 1/n, x). Choose one of these elements and denote it by 
dy. Then {a,,} is a sequence in S satisfying 


1 
eS = i, for alln € Z*. 
n 


By squeeze theorem, the sequence {a,,} converges to 2. 
Conversely, assume that every real number ~ is the limit of a sequence in S. 


We want to show that S is dense in R. Let (a, b) be an open interval. Take 
any point x in the interval (a,b). By assumption, there is a sequence {c,,} 
in S which converges to x. By Lemma 1.35, the interval (a,b) contains a 
point of S. Thus we have shown that every open interval (a, b) contains a 


point of S. This proves that S' is dense in R. 


Example 1.26 


Let 2 = V2, and define the sequences {p,,} and {qn} by 


= m= V2. 


Ne 


Pn 


Here |a| is the floor of a. By definition, 
10/2 — 1 < |10"/2| < 10°. 


Therefore, 


1 
V2— 2 < Pa S V2. 


By squeeze theorem, {p,,} converges to /2. Since [10"/2| is an integer, 
Pn is a rational number. Hence, {p,,} is a sequence of rational numbers that 
converges to x = V2. Obviously, {q,} is a sequence of irrational numbers 
that converges to x = V2. 


The number p,, is the rational number obtained by truncating the decimal 
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expansion of \/2 to give a number with n decimal places. The first 7 terms of 
the sequence {p,,} are 


1.4, 1.41, 1.414, 1.4142, 1.41421, 1.414213, 1.4142135. 


Now we introduce the concept of closed sets. 


Definition 1.34 Closed Set 


Let S be a subset of R. We say that S is closed in R provided that if {a,,} 
is a sequence of points in S' that converges to the limit a, the point a is also 
in S. 

Example 1.27 


The three statements in Lemma 1.29 imply that intervals of the form 


(—oo, a], [a, 00) and [a,b] are closed subsets of R. In particular, we call 
them closed intervals, and [a, b] is a closed and bounded interval. 


Remark 1.2 


1. By definition, R is closed in R. 


2. 0 is closed in R because the statement that defines a closed set is a 
statement of the form p — q, where p is always false for an empty 
set. Hence, for an empty set, this statement p — q that defines a closed 
set is vacuously true. 


Example 1.28 


Is the interval (0, 2) closed in R? 


Solution 


The sequence {1/n} is a sequence in the interval (0,2) that converges to 


the point 0 that is not in (0, 2). Hence, the interval (0, 2) is not closed in R. 
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Remark 1.3 


One can prove that if S is an interval of the form (a, b), or (a, 6], or [a, b), 


or (—oo, a), or (a, 00), then S is not closed in R. 


Example 1.29 


Is the set of rational numbers Q closed in R? 


Solution 
We have seen in Example 1.26 that there is a sequence in the set Q that 


converges to /2, which is not in Q. Hence, Q is not closed in R. 


The concept of closed sets is defined in terms of limits of sequences. This 
leads us to the concept of limit points. 


Definition 1.35 Limit Points 


Let S be a subset of real numbers. A point x in R is called a limit point of 
the set S' if there is a sequence of points in S \ {a} that converges to «x. 


Notice that {a,,} is a sequence in S \ {x} if and only if it is a sequence in S 
with none of the terms a,, equal to x. 


Example 1.30 


In the solution of Example 1.28, we have seen that the sequence {1/n} in 
(0,2) converges to the point 0. Since none of the a,, is 0, 0 is a limit point 
of the set (0, 2). 


Limits and Limit Points 
Although the concepts of limits and limit points are closely related, one 
should not get confused. The limit of a convergent sequence {a,,} is not 


necessarily the limit point of the set {a,|n € Z*}. For example, c is the 


limit of the constant sequence {a,,} with a,, = c for all n € Z*, but c is not 
a limit point of the set {a, |n € Z*} = {c}. 
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Example 1.31 


Determine the set of limit points of the set (0, 2). 


Solution 
We claim that every point in [0, 2] is a limit point of the set (0, 2). 
Example 1.30 shows that 0 is a limit point of (0, 2). The sequence {2—1/n} 
is a sequence in (0, 2) that converges to 2. Hence, 2 is also a limit point of 
(052). 
For any c € (0,2), c > 0. Let m be a positive intger such that 1/m < c. 


Then {c — 1/(n + m)} is a sequence in (0, 2) that converges to c. Hence, c 


is a limit point of (0, 2). 
This completes the proof that the set of limit points of (0, 2) is [0, 2). 


Remark 1.4 


1. For intervals of the form (a,b), (a,b], [a,b) or [a,b], the set of limit 


points is [a, b]. 


2. For intervals of the form (—oo, a) or (—oo, a], the set of limit points is 


(—o0, a]. 


3. For intervals of the form (a, co) or [a,co), the set of limit points is 


[a, co). 


Example 1.32 


Show that the set Z does not have limit points. 


Solution 
If n is an integer, x is contained in the open interval (n — 1, +1) that does 
not contain any integer other than n itself. Hence, there is no sequence in 
Z \ {n} that converges to n. Therefore, an integer n is not a limit point of 
Z. 
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If x is not an integer, it is contained in the interval (|x|, [x]) that does not 


contain any integers. By Lemma 1.35, x is not a limit of a sequence in Z. 
Therefore, x is not a limit point of Z. 


Definition 1.36 Isolated Points 
Let S be a subset of real numbers. We say that x is an isolated point of S if 
(a) x isin S; 


(b) x is not a limit point of S. 


By definition, we have the following. 
Isolated Points vs Limit Points 
A point in a set S is either a limit point or an isolated point of the set. 


Example 1.33 


By Example 1.32, every point in the set of integers Z is an isolated point of 
the set. 


The following is quite obvious from the definition of isolated points and Lemma 
Taos 


Theorem 1.38 


Let S' be a subset of real numbers. A point x in S is an isolated point if and 
only if there is a neighbourhood (a, b) of x that intersects the set S only at 
the point x. 


We have seen that a limit point of a set is not necessarily a point of that set. 
The following gives a characterization of closed sets in terms of limit points. 


Theorem 1.39 


Let S be a subset of real numbers. The set S' is closed in R if and only if it 


contains all its limit points. 
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To prove a statement of the form p <= gq, we can provep = > gq and 


Assume first S is closed in R. Let x be a limit point of S. Then there is 


a sequence {a,,} in S \ {x} that converges to x. In particular, {a,,} is a 


sequence in S that converges to x. Since S' is closed in R, x is in S. This 


proves that S contains all its limit points. 


Now assume that S' is not closed in R. Then there is a sequence {a,,} in S 


that converges to a point x, but x is not in S. Since « is not in S, none of 
the terms in the sequence {a,,} is in S. Therefore, x is a limit point of S. 
This shows that S' does not contain all its limit points. 
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Exercises 1.6 
Question 1 


Show that every real number is a limit point of the set of rational numbers. 


Question 2 
Let S' be the set 


1 
s={> neat Oe: 
n 
(a) Find the set of limit points and the set of isolated points of S. 


(b) Is S aclosed set? 


Question 3 


Determine whether each of the following is a closed set. 
(a) A= [2.3| Ur [4 7 
(b) B = (—o0, 2] U[3, 5] 


(c) C=R\(-1,)) 


(d) D = (1,2) U2, 4] 


(e) B= (1,2) U (3, 4] 
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1.7 The Monotone Convergence Theorem 


Recall that a sequence {a,,} is monotone if it is increasing or it is decreasing. 
Obviously, an increasing sequence is bounded below, and a decreasing sequence 
is bounded above. However, a monotone sequence is not necessary convergent. A 
simple example is the sequence of natural numbers {7}. In the following, we give 


a characterization for a monotone sequence to be convergent. 
Theorem 1.40 The Monotone Convergence Theorem 
Let {a,,} be a monotone sequence. 


1. If {a,,} is increasing, then {a,,} is convergent if and only if it is bounded 
above. In this case, 


lim Gy, = SUP {Gp}. 
n> co 


2. If {a,,} is decreasing, then {a,,} is convergent if and only if it is bounded 
below. In this case, 


limita — milan 
n—- Ooo 


Convergence Criteria for Monotone Sequences 


The monotone convergence theorem says that a montonone sequence is 


convergent if and only if it is bounded. 


It is suffices to prove the case where {a,,} is an increasing sequence. 


First suppose that {a,,} is an increasing sequence that is convergent. Then 
{a,,} is bounded. So it is bounded above. 

Conversely, suppose that {a,,} is an increasing sequence that is bounded 
above. Then a = sup{a,,} exists. Now we use the same argument as in 
the proof of Lemma 1.34. Given € > 0, since a — ¢ is less than a, it is not 


an upper bound of the set S = {a,|n € Z*}. Hence, there is a positive 


integer NV such that 


Qn > a—€E. 
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It follows that 


Qn > an >a—e foralln > N. 


Since a is an upper bound of S, we also have a, < a for all n. Thus, 


lan —al| <eé for alln > N. 


This shows that the sequence {a,,} converges to a. 


The monotone convergence theorem is very useful because we can conclude 
the convergence of a sequence without apriori knowing the limit of the sequence. 
It is a consequence of the completeness axiom which asserts that any set that is 
bounded above has a supremum. 


Example 1.34 


Let a be a number in the interval (0, 1). Show that 


lim a” = 0. 
n—-oo 


Remark 1.5 


It follows from Theorem 1.27 that for any a in the interval (—1, 1), 


lim a” = 0. 
noo 


Solution to Example 1.34 


Since 0 < a < 1, for any positive integer NV, 


GO Sa kaa”. 


Hence, the sequence {a”} is decreasing. On the other hand, a” > 0 for all 
n € Z*. Hence, {a"} is a decreasing sequence that is bounded below. By 


the monotone convergence theorem, {a”} converges to a number ¢. 
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Since {a"*'} is a subsequence of {a}, it also converges to @. Applying 
limit law to 


we have 


= lim at! =a lim a” = al. 
n-co n-oco 


Since a # 1, we must have ¢ = 0. 


Example 1.35 
Define the sequence {a,,} inductively by a; = 1 and for all n > 1, 


Din Se 2) 
Opt — : 
4 rae 


Show that {a,,} is convergent and find its limit. 


Solution 
First notice that a,, > 0 for alln € Z*. When n > 2, 


2Qn+2 2an-1+2 2(Gn — Gn—1) 
An4+1 — an = pe = : 
An a 2 An-1 at 2 (ap =P 2) (Gnoi ale 2) 


Now, a2 = 4/3 > a,. Hence, we deduce that a,4; —a, > 0 foralln € Zt. 
In other words, {a,,} is an increasing sequence. For all n > 1, 


2 
nt41 =2—- <I). 
An+1 mS 


Hence, {a,,} is bounded above by 2. Since {a,,} is an increasing sequence 
that is bounded above, by monotone convergence theorem, it converges 
to a limit u = sup{a,}. Since {a,,,;} is a subsequence of {a,,}, it also 
converges to u. Apply the limit laws to 


2dn, + 2 
An+1 = 


we find that 
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This implies that 


u? = 2. 


Since a,, > 0, we must have u > 0. Hence, u = V2. 


Notice that Example 1.35 is closely related to Example 1.6. The sequence 
{a,} defined in Example 1.35 is another sequence of rational numbers which 
converges to V2. 

The next example is a classical one. 


Example 1.36 


Show that the limit 


Solution 


(Ha) 
ee 
n 


Given a positive integer n, notice that 


Cpa 22 (n+2)n\" 
Qn ntl (n+ 1)? 


By Bernoulli’s inequality (see Question 1.2.2), 


(eat) ~C- gay) 2 gE eae 


It follows that 


Anti. (n+2)(ni+n+1) _ ni +3n*+3n+2 
in (n+ 1)8 ni +3n2 4+ 3n+1 


This shows that 
ee ie for alln € ZT. 
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Hence, {a,,} is monotonically increasing. Using binomial expansion, we 
have 
Ae 
k=0 
For k > 1, Question 1.2.1 shows that 


(") De ers fea) 


nk kl n 
Therefore, 


1 1 1 
ee eee =3- a 
Gre Mise re 


This proves that {a,,} is bounded above by 3. Since {a,,} is an increasing 
sequence that is bounded above, the monotone convergence theorem asserts 
that the limit 


: : ie 
lim a, = lim (1 + - | 
noo noo n 


The Number e 
The number e is defined as 


1 n 
e= lim (1 + = | 5 
n—-0o n 
Correct to 15 decimal places, its numerical value is 
e = 2.718281828459046 


One can show that the sequence {b,,}°°., defined by by = 1, 
1 
bn = bn-1 + — for all n > 1, 
n! 


also converges to e. In series notation, 


ike: 1 
e=1l+o4+ 5454-04 


i or gi are 
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Exercises 1.7 


Question 1 
Given that the sequence {a,,} is defined by a, = 2, and for all n > 1, 


3a, +1 
(re, — : 
lies An +2 


Show that {a,,} is convergent and find its limit. 


Question 2 


For n > 1, let 


Ca) 
Ges | bea 
n 


Define the sequence {b,, }°.9 by bo = 1, and for all n > 1, 


1 
bn = baat st oa 
n) 


(a) Show that the sequence {b,,} is convergent. 


(b) For a positive integer n, use the binomial expansion of a,, to show that 
An, < b, and 


3 
oo ee 
a 7 Pi 


(c) Conclude that the sequence {b,,} converges to e. 
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1.8 Sequential Compactness 


Let us first look at an example. 


Example 1.37 


Let {a,,} be the sequence defined by 


Obviously, 
ipa 
Hence, the sequence {a,,} is bounded. Now, 
GE 1 an 


i es ie 22S = ee 


The subsequence {a2,_1} converges to 1, whereas the subsequence {da2,,} 
converges to —1. Since there are two subsequences that converge to two 
different limits, the sequence {a,,} is not convergent. 


In this example, we find that although the sequence {a,,} is not convergent, it 
has convergent subsequences. In this section, we are going to prove that every 
bounded sequence has a convergent subsequence. By monotone convergence 
theorem, it is sufficient to prove that every sequence has a monotone subsequence. 
It can be achieved via a concept called peak index. 


Definition 1.37 Peak Index 


Let {a,,} be a sequence of real numbers. A positive integer m is called a 
peak index of the sequence if 


Am > On for all n > m. 


In other words, there is no term after the m™ term that is larger than a,,. 


If {a,,} is a decreasing sequence, every positive integer is a peak index of the 
sequence. If {a,,} is an increasing sequence, m is a peak index if and only if 
An = Mm for all n > m, which means {a,,} is a constant from the m"™ term on. 
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We can use the concept of peak indices to prove the following. 


Theorem 1.41 


Every sequence has a monotone subsequence. 


Given a sequence {a,,}, let S be the set of its peak indices. It is a subset of 
positive integers. We discuss the cases where S is infinite and S is finite. 
Case 1: S is infinite. 

Let n1, N2, 73, ... be the elements of S' arranged in increasing order, namely, 


Mi <n < WB <P o> 2 


This is a subsequence of {n}. For any positive integer k, since np41 > Nx 
and nx is a peak index, we have 


Anny, S Anz: 


This shows that {a,,, } is a decreasing subsequence of {a,, }. 
Case 2: S is finite. 
If S is an empty set, let n; = 1. If S is not empty, it has a largest element 


Nmax- Let ny = Nmax + 1. Then for any integer n such that n > nj, n is 
not a peak index of the sequence. Since 7, is not a peak index, there is an 
M2 > nN, such that a,, > @,,. Suppose that we have chosen the positive 


integers 21, 79,..., Nz Such that ny < no < +--+ < nz and 
EG poe dy 


Now nx is not a peak index implies that there is a positive integer nz+1 
larger than n;, such that 


Ghee Une 


This procedure constructs the increasing subsequence {a,,, } inductively. 
In both cases, we have shown that {a,,} has a monotone subsequence. 


Obviously, a subsequence of a bounded sequence is bounded. It follows from 


the monotone convergence theorem the following important assertion. 
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Theorem 1.42 Bolzano-Weierstrass Theorem 


Every bounded sequence has a convergent subsequence. 


Now we want to introduce a concept called Cauchy sequence, which is closely 
related to completeness axiom. 


Definition 1.38 Cauchy Sequence 


A sequence {a,,} is called a Cauchy sequence provided that for any < > 0, 
the is a positive integer NV such that for allm >n > N, 


|Qm — Gn| < €. 
Example 1.38 


; ae ee. aes 
For the sequence {a,,} with a, = , it is easy to check that it is a 
n 


Cauchy sequence. Notice that if m > n, 


1 1 1 1 
lm — Qn| = |— —- =—-—<-, 
D4 2 re ae 


Given ¢ > 0, the Archimedean property says that there is a positive integer 
N such that 1/N < ¢. Hence, ifm >n>N, 


There is a similarity between the definition of a Cauchy sequence and the 
definition of convergence of a sequence. We can show that a linear combination 
of Cauchy sequences is a Cauchy sequence, and a product of Cauchy sequences 
is a Cauchy sequence. For the quotient, some care need to be taken. We leave it 
to the students to formulate the precise statement. 

In the definition of a Cauchy sequence, we do not need to know whether the 
sequence is convergent, or what is the limit of the sequence if it is convergent. 
Nevertheless, a convergent sequence is a Cauchy sequence. 


Chapter 1. The Real Numbers 75 


Theorem 1.43 


If a sequence {a,,} is convergent, then it is a Cauchy sequence. 


Let a be the limit of the convergent sequence {a,,}. Given € > 0, there is a 


positive integer N such that for alln > N, 


E 
lan — al < a 


It follows from triangle inequality that ifm >n => N, 


Ee  € 
Jam — On] S lam — a + [dn — al <5 +5 =. 


Hence, {a,,} is a Cauchy sequence. 


The converse is also true in the set of real numbers. It is proved using the fact 
that every bounded sequence has a convergent subsequence. 


Theorem 1.44 Cauchy Criterion for Convergent Sequennce 


If {a,,} is a Cauchy sequence of real numbers, then it converges to a real 
number. 


First we prove that {a,,} is a Cauchy sequence implies that it is bounded. 
The proof is almost identical to the proof that a convergent sequence is 
bounded. Take « = 1. There is a positive integer No such that for all 
ee NG. 


leer le 


This implies that 


lam| < lan,|+1 for all m > No. 
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Let 


M = max{|aj|,..., |@np-1|, |an,| + 1.} 
Then |a,,| < M for all n € Z*, proving that it is bounded. Since {a,,} is a 
bounded sequence, it has a convergent subsequence {a,,, } which converges 
to a limit a. We want to prove that the sequence {a,,} also converges to a. 
Given < > 0, there is a positive integer N such that for all m > n > N, 


€ 
lin — Gn |< 5 


There is a positive integer K such that for all k > k, 


E 
Lain ele oe 


Now let n be an integer such that n > N. Since {n;} is a subsequence of 
{n}, there is an integer & such that k > K and n, > n. Then 


E € 
Jan — a] S Jan, — dn] + lan, — al <5 +5 =e 


This proves that for alln > N, 
lan — al <e. 


Hence, the sequence {a,,} indeed converges to a. 


Theorem 1.44 is proved using the fact that every bounded sequence has a 
convergent subsequence. The latter is a consequence of the monotone convergence 
theorem, whose validity relies on the completeness axiom for real numbers. Hence, 
the fact that every Cauchy sequence of real numbers is convergent is a consequence 
of the completeness axiom. 

If we consider the set of rational numbers, the assertion is not true. For 
example, we have shown that there is a sequence of rational numbers {a,,} that 
converges to \/2. Therefore, the sequence {a,,} is a Cauchy sequence that does 
not converge in the set of rational numbers. 


The following combines the results of Theorem 1.43 and Theorem 1.44. 
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Cauchy Criterion for Convergent Sequennce 


A sequence of real numbers {a,,} is convergent if and only if it is a Cauchy 


sequence. 


As the monotone convergence theorem, the Cauchy criterion can be used to 
conclude the convergence of a sequence without apriori knowing the limit of the 
sequence. It has wide applications as we are going to see in latter chapters. 


Example 1.39 


For a positive integer n, let 


Show that the sequence {s,,} is divergent. 


Solution 
We prove that {s,,} is not a Cauchy sequence, by showing that for « = 1/2, 
for any positive integer VV, there are integers m and n with m > n > N 
such that ; 
[Sm — Sn| > oF 
For a given positive integer NV, letrn = N andm=2N. Thenm >n > N 


and m — n = N. Notice that 


1 
IA See 


This shows that {s,,} is not a Cauchy sequence. Hence, it is not convergent. 


We have studied the convergence of sequences, and the interplay between 
sequences and sets. Now we define another property of sets called sequential 


compactness. 
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Definition 1.39 Sequential Compactness 


Let S be a subset of real numbers. We say that S' is sequentially compact 


provided that every sequence in S' has a subsequence that converges to a 


point in S. 


Using logic, we find that a set S is not sequentially compact if there is a 


sequence in S that do not have a convergent subsequence with limit in S. 


From the theories that we have developed in this chapter, it is not difficult to 


prove the following. 


Theorem 1.45 


If S is a closed and bounded subset of real numbers, then it is sequentially 


compact. 


Let S' be a subset of | 


R that is closed and bounded. Given a sequence {a,,} 


in S, since S is bounded, the sequence {a,,} is bounded. Therefore, there 


is a subsequence {a,,,} that converges to a number a. Since {a,,} is a 


sequence in the set S that converges to a, and S is closed, the limit a must 


be in S. In other words, we have shown that the sequence {a,,} in S has a 


subsequence {a,,, } that converges to a point a that is in S. This proves that 


S is sequentially compact. 


Example 1.40 


Since an interval of the form [{a, b] is closed and bounded, it is sequentially 


compact. 


The converse to Theorem 1.45 is also true. 


Theorem 1.46 


Let S be a subset of 
bounded. 


R. If S is sequentially compact, then it is closed and 


This is a statement of the form p > q/r. It is equivalent to (p > q)A(p > r), 
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which in turn is equivalent to (=qg + —p) A (=r + 7p). Hence, we will prove the 
following two statements: if S' is not closed, it is not sequentially compact; and if 
S is not bounded, it is not sequentially compact. 


First, we prove that if S is not closed, it is not sequentially compact. If S is 


not closed, there is a sequence {a,,} in S which converges to a point a but 


ais notin S. For this sequence, every subsequence is convergent with limit 
a. Hence, this sequence does not have a convergent subsequence with limit 
in S. This proves that S is not sequentially compact. 

Next, we prove that if S is not bounded, it is not sequentially compact. If S 
is not bounded, for each integer n, there is a point a,, in S' such that 


feral eee 
Consider the sequence {a,,}. If {a,, } is a subsequence of {a,}, 
|r| 2 Nk: 


Hence, the sequence {a,,,} is not bounded, and thus it is not convergent. 
This shows that the sequence {a,} does not have any convergent 
subsequence. Therefore, S' is not sequentially compact. 


Combining Theorem 1.45 and Theorem 1.46, we have the following. 


Characterization of Sequentially Compact Sets 


A subset of real numbers is sequentially compact if and only if it is closed 


and bounded. 


Notice that the only type of intervals that is both closed and bounded is the 
type [a,b]. Hence, this is the only type of intervals that are sequentially compact. 
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Example 1.41 


Determine whether each of the following sets is sequentially compact. 


(a) Z 


(bo) A= [2,5] \ {3} 


(c) B= (0,6) N (4, 7]. 


Solution 


(a) The set Z is not bounded. Hence, it is not sequentially compact. 


(b) 3 is a limit point of the set A but it is not in A. Hence, A is not closed, 
and so it is not sequentially compact. 


(c) B = [4,6] is closed and bounded. Hence, B is sequentially compact. 


It might be wondered why there is a need to introduce the concept of sequential 
compactness if it is equivalent to closed and bounded. We will see that for a 
subset of real numbers that is closed and bounded, every sequence in that set has a 
subsequence that converges to a point in that set is a very important characteristic. 
By introducing the concept of sequential compactness, we can avoid repeatedly 
proving this property for a set that is closed and bounded. 

The next theorem gives an important feature of a sequentially compact set. 


Theorem 1.47 


Let S be a subset of real numbers. If S is closed and bounded, then it has a 
maximum and a minimum. Equivalently, if S is sequentially compact, then 
it has a maximum and a minimum. 


Since S is bounded, S has a least upper bound u and a greatest lower bound 


é. By Lemma 1.34, there are sequences {u,,} and {,,} in S' that converge 


to u and ¢ respectively. Since S is closed, u and @ are in S. Since wu = sup S 
is in S, S has a maximum. Since @ = inf S is in S, S has a minimum. 
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Exercises 1.8 


Question 1 


Given that the sequence {a,,} is defined by 


=i eee 
tp = Be es We pees: 


Show that {a,,} is not a Cauchy sequence. Then conclude that the sequence 
{a,} is divergent. 


Question 2 


Determine whether each of the following sequence is a Cauchy sequence. 


ae 
(a) The sequence {a,,} with a, = = 


=CIy 
ae: 


(b) The sequence {b,,} with b,, = 1—(—l*n 


Question 3 


Determine whether each of the following sets is sequentially compact. 
(a) A= {1,2,--- , 100} 
(b) B= [4,71 6,8] 


Question 4 


Show that the union of two sequentially compact sets is sequentially 
compact. 
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Chapter 2 


Limits of Functions and Continuity 


In this chapter, we study functions f : D — R defined on a subset of real numbers 


D, and taking values in the set of real numbers R. Polynomials and rational 


functions are special examples. When we do not specify the domain of a function, 
we will take its domain D to be the largest subset of real numbers where the 
function can be defined. 


Definition 2.1 Polynomials and Rational Functions 


A polynomial is a function p : R — R of the form 


p(x) = Gite + Ge -+ seed ++ a,x ++ ao; 


where do, @1,...,@,, are constants. We call p(x) a polynomial of degree n 
if a, ~ 0. A rational function is a function of the form 


where p(x) and q(x) are polynomials, and q() is not the zero polynomial. 


The domain of this function is the set D = R\S, where S is the finite point 
set containing all x for which q(x) = 0. 


For example, the domain of the rational function 


eet 
xr+2 


is the set D = R \ {—2}. 

To be able to apply tools in analysis, we are interested in functions that are 
continuous. Continuity can be defined in two different ways that are equivalent. 
One is using positive numbers 6 and € to measure distances of points in the domain 


and range, while the other is using limits of sequences. 
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The limit of a function f : D — R when the variable x approaches a limit 


point x of the domain D is an important concept in defining derivatives. This 


concept can be defined for any function f : D — R whose domain D contains 
limit points. There is a close relation between the limit of a function f(a) when x 
approaches a limit point zo, and the continuity of the function at xo. 

Although the continuity of a function can be defined independently of limits 


of functions, we choose to consider limits of functions first. 


2.1 Limits of Functions 


In Section 1.6, we have defined the concept of limit points of a set D. The point 
Xo is a limit point of the set D if there is a sequence of points in D \ {xo} that 
converges to Zp. A limit point of a set is not necessarily in that set. A set that 
contains all its limit points is a closed set. If a point zo is in a set D but is not a 
limit point of D, it is called an isolated point of D. If xo is an isolated point of D, 
there is a neighbourhood (a, b) of xo which intersects the set D only at the point 
Xo. 

Limits of functions can be defined using the e — 6 language or using limits of 
sequences. We will define the concept using limits of sequences first, and then 
show that it is equivalent to the < — 6 definition. 


Definition 2.2 Limits of Functions 


Let D be a subset of real numbers and let xp be a limit point of D. Given 


a function f : D — R, we say that the limit of f(x) as x approaches xo 


is €, provided that whenever {x,,} is a sequence of points in D \ {ao} that 


converges to Xo, the sequence { f(z,,)} converges to @. 


If the limit of f : D — Ras x approaches 29 is ¢, we write 


Notice that we do not define lim f() if xo is not a limit point of the domain 
bie a4 010) 


where the function is defined. 
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Logical Expression for Definition of Limits 


lini (i —— = 


H bho a9 10) 


Vi eae eas se eg he 


Let us first look at some examples. 


Example 2.1 


Find the limit if it exists. 


@) a v2+1 


Solution 


(a) The function 
— 224+3 


AOI ee 


is defined on D = R. If {a,,} is a sequence in R \ {1} that converges 


to 1, limit laws imply that 
: tes eI 
nes) = BS ea ET 


N—->Co 


2z+3 5 


im =n, 
a1 7241 2 


Chapter 2. Limits of Functions and Continuity 85 


(b) The function 
x1 
f(x) =< 
is defined on D = R \ {1}. If {x,} is a sequence in R \ {1} that 
converges to 1, limit laws imply that 


; ye eal 
IT alee TS e—tlbtie Tylor pally ak 


noo N= OO! Gi — n—-0oo 


The function 


is defined on D = R \ {1}. Consider the sequence {x,,} with 


yee 
n 


We find that 
1 2 
er ar Sapa 
n 
The sequence { f(2,,)} is not bounded, and so it is divergent. Hence, 
the limit 


does not exist. 


In part (b), we have used the fact that x, 4 1 to simplify f(z,,) to x, + 1. 

Using laws for limits of sequences, it is immediate to see that limits of functions 
respect taking linear combinations and multiplications. It also respects taking 
quotients provided that the function on the denominator does not approach 0. 
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Proposition 2.1 Limit Laws for Functions 


Let D be a subset of real numbers. Given that f : D > Randg: D—- | 
are functions defined on D, xo is a limit point of D, and 


lima f(a) — ey, limi g(a — 15 


xL>XO LLOQ 


1. For any constants a and 3, lim (af + 6g)(x) = afi + Ber. 
HM bie 4 110) 


22 tne (a. 


H be a 0) 


3. If g(x) £0 for all x € D, and ¢ ¥ 0, then 


hoe 


i = =. 
z—xo g(x) by 


From this proposition, it follows that we can take limits of a rational function 
easily at a point which is not a zero of the polynomial in the denominator. 


Proposition 2.2 


Let p(x) and q(x) be polynomials. If ao is a real number such that q(x) # 
0, then 


Let us now look at an example that involves the absolute values. 


Example 2.2 


Show that for any real number Zo, 


hina |Z) =| 
xL—->XO 
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Solution 


Let {x,} be a sequence in R \ {x} that converges to xo. By Question 1.5.4, 


the sequence {|z,,|} converges to |ao|. This proves that 


ibnen ie = bank 
xL—->XO 


Now we want to formulate an equivalent definition for limits. 


Theorem 2.3 Equivalent Definitions for Limits 


Let D be a subset of real numbers, and let xo be a limit point of D. Given 


a function f : D > R, the following are two equivalent definitions for 


(i) Whenever {z,,} is a sequence of points in D \ {xo} that converges to 
Xo, the sequence { f(x,,)} converges to @. 


(ii) For any € > 0, there is ad > O such that if the point x is in D and 
0 < |x — xo| < 6, then | f(x) — @| <e. 


In logical notation, we can express (ii) as follows. 
Logical Expression for Second Definition of Limits 


ims (eo) =. <—— 


rL—->>XO 


VYe> 0, 40> 0, Va (oe D) AM = |g =a9| = 8) = Po) —4\ <=. 


Here 6 is a measure of the closeness of the point x € D to the point xo, and 
€ is a measure of the closeness of the function value f(x) to the number @. The 
condition |x — xo| > 0 is to stress that we only consider those points x that is 
not Xo. From the definitions, we can see that the limit of a function f(x) when x 
approaches 9 does not depend on how the function f is defined at xo, and f does 
not need to be defined at x9 for the limit to be defined. 

To prove Theorem 2.3, we need to show that (1) <=> (ii). This is equivalent 
to Gi) = > (i) and-= (ii) => = (i). 
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Proof of Theorem 2.3 
We start by showing that if (i1) holds, then (i) holds. Assume that (11) holds. 
To prove (i), we take a sequence {x,} in D \ {xo} that converges to the 
point 2. We want to show that the sequence { f(x,,)} converges to 7. We 
prove this using the definition of convergence of sequences. Given ¢ > 0, 
our assumption that (ii) holds implies that there is a 0 > O such that for 
all x that is in D with 0 < |x — xo| < 6, we have |f(x) — @| < «. Since 
{x,,} converges to Xo, there is a positive integer N such that for alln > N, 
|2n — Xo| < 6. By our definition, x,, are points in D \ {a}. Hence, for all 
n> N, 
If(tn) — A <e. 


Since we have shown that for all « > 0, there is a positive integer N such 
that for alln > N, | f (an) — | < €, we conclude that the sequence { f(x,,)} 
converges to ¢. This proves (i) holds. 

Now assume that (ii) is false. In logical notation, this means 


See Oe Or 0 a aren (eee |r argc aa eA alent een 


Namely, there is an ¢ > 0 such that for any 6 > 0, there is a point x in 
D \ {xo} with |x — xo| < 6 but |f(x) — ¢| > ©. For this e > 0, we 
construct a sequence {z,,} in D \ {xo} in the following way. For each 
positive integer n, there is a point x, in D \ {xo} such that |x, — xo| < 1/n 
but | f(z,) — €| > e. Then {z,,} is a sequence in D \ {xo} that satisfies 


1 
|2n — Lo| < —. 
n 


Since lim 1/n = 0, we find that the sequence {x,,} converges to x9. Since 
n> oo 


lf (an) — | > © for alln € Z*, the sequence { f(x,,)} cannot converge to 
¢. Hence, we have shown that there is a sequence {z,,} in D \ {xo} that 
converges to x but {f(z,,)} does not converge to ¢. This proves that (i) 
does not hold. 
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Example 2.3 The Heaviside Function 


The Heaviside function H : | IR is defined by 


hits ee 1 


tie <0) 


For any real number xo, determine whether the limit lim H(z) exists. 
xL—->XO 


Figure 2.1: The Heaviside function H(x). 


Solution 
We consider the cases where %9 > 0, % < 0 and xp = 0. 
Case 1: x > 0. In this case, we claim that lim f(x) = 1. 
L—>Xo 


Given € > 0, take 6 = xp. Then 6 > 0. If x isin Rand 0 < |x — ao| < 6 = 
Xo, we have x — Xp > —Xo and hence x > 0. Thus f(x) = 1 and 


f(z) — 1) =0<e. 


This proves that lim f(a) = 1. 
xL>XLO 


Case 2: xo < 0. In this case, we claim that lim f(x) = 0. 
zr->xr0 


Given € > 0, take 6 = —2o. Then 6 > 0. If x is in R and 0 < |x — xo] < 
3 = —2Xo, we have x — 2 < —%o and hence x < 0. Thus f(x) = 0 and 


f(x) —0| =0<e. 


This proves that lim f(x) = 0. 


LX 
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Case 3: x, = 0. In this case, we claim that lim f(a) does not exist. Let 
xL—->XO 


{uy} and {v,,} be the sequences {1/n} and {—1/n} respectively. They are 


both sequences in R \ {0} that converge to 0. 
pater pole tcl (cen for alln € Zt. 
Therefore, 
Iba ese and lites, 
n-00 n—00 


Since {f(xz,)} has different limits when we consider two different 


sequences {z,,} in R \ {0} that converge to 0, we conclude that lim f(z) 
xL—->XO 


does not exist. 


In this example, we can also use the ¢ — 6 definition to show that lim f(x) does 
xr 


not exist. Assume that lim f(x) exists and is equal to . Take ¢ = 1/2. There 
xr 


exists 6 > 0 such that for any x € R, if 0 < |x — 0| < 6, then 
f(z) —2| <e. 


Now the points x = x, = —d/2 and x = x2 = 6/2 both satisfy 0 < |x — 0| < 6. 
We have f(x,) = 0 and f(x2) = 1. By triangle inequality, 


lf(x1) — F(z2)| < |f(e1) — 2) + | fee) — 2] < 2e = 1. 


This gives 
1 = |f(1) — f(x2)| <1, 


which is a contradiction. Hence, lim f(a) does not exist. 

In calculus, we have defined the concepts of left limits and right limits to deal 
with functions like the Heaviside function, which is defined by cases. Given a 
subset of real numbers D and a point xo, define 


Dy ,- = {4 € D| x < Zo}, Dine =10 ED |e > ao}. 


For example, consider D = |0,2). If zo = 1, then D;~ = [0,1) and Diy = 
(1,2). If zo = 0, then Do, = 0 and Do, = (0,2). If xo = 2, then D2 = [0, 2) 
and Dy, = 0. 
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Notice that even though 9 is a limit point of D, it might not be a limit point of 
D,,,— OF Dyo,4+. We define the left limit and right limit of a function f : D — R 
when x approaches Zp in the following way. 


Definition 2.3 Left Limits and Right Limits 


Let D be a subset of real numbers and let f : D — R be a function defined 
on D. 


1. If xp is a limit point of D,,,-, D,,,— is not an empty set. We say that the 


limit of the function f : D — Ras x approaches x from the left exists 


provided that the limit of the function f : D,,- —> Ras x approaches 
Xo exists. If the left limit exists, it is denoted by 


Tina (22) or simply as Nina's as 


L>xX0,L< LO T25 


. If xp is a limit point of D,, +, Dz,,+ is not an empty set. We say that the 


limit of the function f : D — Ras x approaches 2p from the right exists 


provided that the limit of the function f : D,,.4 —> Ras x approaches 


Xo exists. If the right limit exists, it is denoted by 


Lie (a) or simply as lima (es 
LEO ,cS x0 cond 


Left Limits, Right Limits, and Limits 


. If xo is a limit point of both D,,,, and D,,-, then lim f(a) exists if 


xL—->xXLO 
and only if both lim f(a) and lim, f(a) exist and they are equal. 
L£Q L>£G 
. If xp is a limit point of D,,— but is not a limit point of D,,,, then 
lim f(a) exists if and only if lim f(x) exists. 
wL—->XLO = 


I+Loy 


. If xo is a limit point of D,,., but is not a limit point of D,,—, then 


lim f(x) exists if and only if lim f(x) exists. 
rx aoad 
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Example 2.4 


For the Heaviside function, we have 


lines) 0) and Mitac Jee — il, 


x2—0- 20+ 


Since the left and right limits are not equal, lim H(z) dos not exist. 
2 


Example 2.5 The Dirichlet’s Function 


The Dirichlet’s function is the function f : R — R defined by 


if x is rational, 


if x is irrational. 


For any real number xo, determine whether the limit lim f(x) exists. 
L—->Xo 


This is a classical example of a function which we cannot visualize the graph. 


Solution 
Fixed a real number x». For any positive integer n, there is a rational 


number p,, and an irrational number q,, in the open interval (29 — 1/n, x). 


The sequences {p,,} and {q,,} are in R \ {ao} and converge to x. Since 
fin) — 1 “and f(g.) —0 for all n € Z*, 
we find that 
Jim f(pn) = 1 and Jim f(n) = 0. 


Since the sequence {f(x,,)} has different limits when we consider two 


different sequences {2,,} in R \ {xo} that converge to xo, we conclude 


that lim f(x) does not exist. 
L—->Xo 


For this example, if one wants to use the ¢« — 6 definition of limits, one can 


proceed in the following way. For fixed zo in R, assume that lim f(x) = @. 
xL->xLO 


When ¢ = 1/2, there is a d > O such that for any x with 0 < |x — x| < 4, 
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| f(x) — | < ©. The open interval (a9 — 6, 79) contains a rational number x, and 
an irrational number x2. Notice that f(2,) = 1 and f(x2) = 0. Both x = x, and 
xL = £ satisfy 0 < |x — xo| < 6. By triangle inequality, 


|f (v1) — F(z2)| < |f(e1) — 2| + |f (ee) — 2] < 2e = 1. 


This gives 
La | f(a) — 7 (%)| <1, 
which is a contradiction. Hence, lim f(a) does not exist. 
LI—->XO 


Next, we consider composite functions. 


Proposition 2.4 


Given the two functions f : D > Randg:U > R,if f(D) C U, we can 
define the composite function h = go f : D+ Rby h(x) = g(f(z)). If 
Xo is a limit point of D, yo is a limit point of U, f(D \ {ao}) CU \ {yo}, 


Let {x,,} be a sequence in D\ {xo} that converges to xo, and let y, = f(@n) 
for alln € Z*. By assumption, {y,,} is a sequence in U \ {yo}. Since 


lim f(x) = yo, the sequence { f(z,,)} converges to yo. Since lim g(y) = 
L—->XO y+ Yo 


¢, the sequence {g(y,,)} converges to @. In other words, the sequence {(g 0 
f)(an)} converges to @. 

Since we have proved that whenever {z,,} is a sequence in D \ {xo} that 
converges to %o, the sequence {(g o f)(x,)} converges to 0, we conclude 
that 


limiig of (ai. 


LX 


Using the result of Example 2.2, we obtain the following. 
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Corollary 2.5 


Let D be a subset of real numbers. Given a function f : D > R, if xo is a 
limit point of D and lim f(a) = @, then 
xL—->XO 


Jim [f(@)| = (dl 


Example 2.6 


For any 29 > 0, show that 


liane ea 
LO 
Solution 

Let us use the e—6 definition of limits. Consider the case 7, = 0 first. Given 
€ > 0, take 6 = €?. Then 6 > 0. If x > Ois such that 0 < |x—0| < 6 =’, 
we have 0 < x < e’, which implies that 0 < \/z < e. Hence, if x > 0 and 
0< |x —0| <6, 

|Vz — V0 <e. 
This proves that 

lim Ve = Vain 

Now consider the case x, > 0. Notice that 


ZL — Xo 


= ig = ——_—., 
Vi f= Foe 
If z > x9/4, then /x > ,/%o/2 and 


i 2 
< : 
Jat + /Xo 3/9 


3 3 
Given « > 0, let 6 = min | 0, sev}. Then 6 > 0. If x > O and 


0 < |x — xo| < 6, then |x — xo| < gio and so x > gio: Therefore, 
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_ Dy 
Say Ke <e. 


OVE] ee as 


This proves that lim Vx = \/Zo. 
xL—>XO 


(a) (b) 
Figure 2.2: (a) The function f(a) = \/x. (b) The function f(x) = \/z. 


Using similar methods, one can prove that if n is an integer, then for any Zo in 
the domain of the function f(x) = «/z, 


lira </2 = 2/ xp. 


L—->XO 
Now we want to give a brief discussion about limits that involve infinities. 
Definition 2.4 Infinity as Limits of Sequences 


Given that {a,,} is a sequence of real numbers. 


1. We say that the sequence {a,,} diverges to oo, written as lim a, = oc, 


Noo 
if for every positive number /, there is a positive integer NV such that 


foralln > N,a, > M. 


. We say that the sequence {a,,} diverges to —oo, written as lim a, = 


n—->oco 


—oo, if for every positive number 1, there is a positive integer N such 
that for alln > Nia, < —M. 
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Example 2.7 


(a) The sequence {n7} diverges to oo. 


(b) The sequence {—n*} diverges to —co. 


(c) The sequence {(—1)”"n*} neither diverges to co nor to —oo. 


Given that {z,,} is a sequence of real numbers. If {z,,} diverges to 00 or —oo, 
there is a positive integer NV such that x, 4 0 for all n > N. Hence, for sequences 
that diverge to oo and —oo, we can assume none of the terms is zero. 

The following is another characterization of boundedness for a set in terms of 
sequences that diverge to infinity. 


1. A set D is not bounded above if and only if there is a sequence {x,,} in 
D that diverges to oo. 


2. A set D is not bounded below if and only if there is a sequence {x,,} in 


D that diverges to —oo. 


Using these, we can make the following definitions. 
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Definition 2.5 Limits of Functions at Infinity 


Let D be a subset of real numbers that is not bounded above. Given that 


is areal number and f : D —> R is a function defined on the set D. The 


following two definitions for 


lina (a ae 


xL—->Co 


are equivalent. 


(i) Whenever {z,,} is a sequence of points in D that diverges to oo, the 
sequence { f(x,,)} converges to @. 


(ii) For any € > 0, there is a positive number JV such that if the point x is 
in D and xz > M, then 


|f(a) -— A <e. 


Definition 2.6 Limits of Functions at Negative Infinity 


Let D be a subset of real numbers that is not bounded below. Given that 


is areal number and f : D — R is a function defined on the set D. The 


following are two equivalent definitions for 


Ning (aye, 


GE — 12,9) 


(i) Whenever {z,,} is a sequence of points in D that diverges to —oo, the 


sequence { f(x,,)} converges to @. 


(ii) For any € > 0, there is a positive number JV such that if the point x is 
in D and x < —M, then 


|f(a) — el <e. 


Now let us look at a simple example. 
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Example 2.8 


1 
Show that lim — = 0. 


AV ASS) J 


Solution 
We use both definitions to prove the statement. 


Using the sequence definition, let {x,,} be a sequence of nonzero real 


numbers that diverges to 00. We want to show that the sequence {1/z,,} 
converges to 0. Given « > 0, the number / = 1/c is also positive. Since 
the sequence {z,,} diverges to oo, there is a positive integer N such that for 
alln > N, 
1 
eo > MM = =, 
E 
1 
In particular, for alln > N, x, > 0 and 0 < — < é. This proves that the 
In 
sequence {1/2,,} converges to 0. Therefore, lim — = 0. 
L—CO LT 


Now consider the definition in terms of ¢. Given e > 0, let M = 1/e. Then 
M is a positive number. If x in R \ {0} is such that zx > M, then 


Tene : =€E 
i 
: ae! 

This proves that lim — = 0. 


Gp—Ae.0) 9G; 


This example demonstrates that working with the definition in terms of ¢€ is 
sometimes easier. 

It is easy to see that the limit laws given in Proposition 2.1 and Proposition 2.4 
also hold for the case where x —> 00 or x — —oo. We will skip the formulation 
and use it directly. For example, we have the following. 


Example 2.9 


Tere ce 
For any positive integer n, lim — = 0. 
a—oo 7” 


Now let us look at some more examples. 
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y y 
0 7 0 Y 
(a) (b) 


Figure 2.3: (a) The function f(a) = 1/zx. (b) The function f(x) = 1/2”. 


Example 2.10 
Determine whether the limit 


Dies Goan | 
im ——— 
L—-00 gee aL 


exists. If it exists, find the limit. 


Solution 


Divide the numerator and denominator by x, we have 


LAE tee 
u2+7 7 


Using limit laws and the fact that lim 1/x = 0, we find that 
&L—->0o 


2a*+3a+4 _ 2+040_, 
— 140 0°°° 


Chapter 2. Limits of Functions and Continuity 100 


Example 2.11 


Determine whether the limit 


exists. If it exists, find the limit. 


Solution 
Notice that Vx? = |x|. Hence, 


zt —z 
zg? +1 


When z < 0, 


Therefore, 
ees 


a—+—oo |z| 


On the other hand, since 


1 
—w 


LOO x 


lim 1+ 


we find that 
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Remark 2.1 


Using similar ideas, one can formulate analogous definitions for the 
following limits. 


lim f(x) = c0, lim f(x) = —0o, 


xL—->XO IL—->XO 


lim ie =e: Jim f( ) = —-00, 


limi (2) ce, lim f(x) = —oo. 


L—7— CO ®L——Co 


Finally, we would like to mention that there is an analogue of the squeeze 
theorem for functions, whose proof is straightforward. 
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Theorem 2.6 Squeeze Theorem 


Let D be a subset of real numbers. Given that f : D — | 
h: D — Rare functions defined on D and 


Ges CO Ses) for all x € D. 


If xo is a limit point of D and 


lim g(x) = 


xL—>XO 


Exercises 2.1 


Question 1 
Find the limit if it exists. 
eo ae 2 


1m 
r——1 g+1 


ee A 
im ———— 
.) = x+l1 


(a) 


Toned | 
r 
() ney z+1 


at 


.) soa z+l1 
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Question 2 


Define the function f : R > R by 


£+3, hipsne easly 
5-2, if L. 


For any real number xo, determine whether the limit lim f(z) exists. 
L—->XO 


Question 3 


Define the function f : R > R by 


if x is rational; 


if x is irrational. 


(a) Use squeeze theorem to show that lim f(a) exists and find the limit. 
zr 


(b) If zo #0, show that lim f(a) does not exist. 
be at 110) 


Question 4 
Determine whether the limit exists. If it exists, find the limit. 


eee 
(eyouitine 2 laa 
tr>—coo 572+2 


2 3 
(b) lim SES. 
woo /Ag? + 1 


Question 5 


For any % > 0, show that 


hin «/% — ./i9. 


LX 
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2.2 Continuity of Functions 


In this section, we introduce the concept of continuity of functions. 


Definition 2.7 Continuity 


Let D be a subset of real numbers that contains the point xo, and let 
f : D — R be a function defined on D. We say that the function / is 
continuous at 2x9 provided that whenever {x,,} is a sequence of points in 


D that converges to xo, the sequence { f(x,,)} converges to f(x). 


We say that f : D — Risa continuous function if it is continuous at every 


point of its domain D. 


The definitions of limit and continuity are very similar. However, there is a 
slight difference. To define continuity at a point xo, % must be a point in the 
domain of the function D. To define limit, x does not need to be a point in the 
domain D but has to be a limit point of D. When the point vo is in D and is also 


a limit point of D, the relation between limit and continuity is as follows. 


Proposition 2.7 Relation Between Limit and Continuity 


Let D be a subset of real numbers that contains the point xo. If x is a limit 
point of D, then f is continuous at x if and only if 


lim f(x) = f(xo). 


L->xrO 


In other words, it says that if x is a limit point of the domain D, then f is 
continuous at 7 if and only if 


lim (f(a) — f(0)) = 9, 


r—->XO 


if and only if 
lim | f(x) — f(eo)| = 0. 


w—->XO 


The following fact is quite obvious. 
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Proposition 2.8 


Let D be a subset of real numbers and let f : D — R be a function defined 


on D. If f : D — Ris continuous, then for any subset A of D, the function 


f : AR, which is the restriction of f to A, is also continuous. 


Example 2.12 


Proposition 2.2 says that a rational function is continuous. 


Example 2.13 


Example 2.3 says that the Heaviside function H(x) is continuous at x if 
x #0. It is not continuous at x = 0. 


Example 2.14 


Example 2.5 says that the Dirichlet’s function is nowhere continuous. 


Example 2.15 


Example 2.6 says that the function f(a) = \/z is continuous. In general, 
for any positive integer n, the function f(x) = %/z is continuous. 


A natural question to ask is the continuity of a function at an isolated point of 
its domain. Let us first prove the following. 


Lemma 2.9 


Let D be a subset of real numbers and let x be an isolated point of D. 


If {x,} is a sequence of points in D that converges to xo, then there is a 


positive integer n such that x, = x foralln > N. 
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By Theorem 1.38, there is a neighbourhood (a, b) of xo which intersects D 
at xo only. Let ¢ = min{xp — a,b — xo}. Then € > 0 and (a — €, 20 + 


€) C (a,b). Since the sequence {x,,} converges to Xo, there is a positive 


integer N such that for alln > N, |x, — xo| < ¢. Hence, for alln > N, 
In € (Lo — €,%o + €) C (a,b). Since (a,b) A D = {xo}, we find that 
Ln = Lo foralln > N. 


Using this lemma, it is easy to prove the continuity of a function at an isolated 
point of its domain. 


Proposition 2.10 Continuity at an Isolated Point 


Let D be a subset of real numbers that contains the point xp. If xp is an 
isolated point of D, then f is continuous at Xo. 


If {x,,} is a sequence in D that converge to x9, Lemma 2.9 says that there is 
a positive integer N such that x,, = xo for all n > N. Therefore, f(x) = 


f (xo) for all n > N. This implies that the sequence { f(x,,)} converges to 


f (xo). By the definition of continuity, f is continuous at xp. 


Example 2.16 


Since every point of the set of positive integers Z* is an isolated point, any 


function f : Z* — R defined on the set of positive integers is continuous. 


This conclusion might be a bit counter intuitive for students that see it for the 
first time. One can think about it naively in the following way. For an isolated 
point, it has no close neighbours to be compared to. Hence, the limit operation 
does not work, and thus the function is continuous by default. 

Let us summarize again the continuity of a function at a point. 
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Continuity of a Function at a Point 


Let D be a subset of real numbers and let x be a point in D. Given that 
f : D — Risa function defined on D. 


1. If x is an isolated point of D, then f is continuous at xo. 


2. If xo is a limit point of D, then f is continuous at x if and only if 


lim f(a) = f(xo). 


ie a4 10) 


Similar to limits, we also have an equivalent definition for continuity in terms 
of 6 and. 


Theorem 2.11 Equivalent Definitions for Continuity 


Let D be a subset of real numbers and let xp be point in D. Given a function 


f : D—- R, the following two definitions for f to be continuous at xo are 
equivalent. 


(i) Whenever {x,,} is a sequence of points in D that converges to 9, the 
sequence { f (a,,)} converges to f (ao). 


(ii) For any € > 0, there is a 6 > O such that if the point x is in D and 
|z — xo| < 6, then | f(a) — f(zo)| < e. 


The proof of Theorem 2.11 is almost identical to the proof of Theorem 2.3. 


Example 2.17 


Use the e — 6 definition to show that the function f : R \ {0} — R defined 


1 
by a) = is continuous. 


Solution 
The domain of the function is D = R \ {0}. Let xo be a point in D. Then 
Xo # 0. Notice that 
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then 


Given < > 0, let 


Z z, 
If x in D is such that |x — xo| < 6, then |x — xo| < a and so |x| > [ol 


2 
It follows from (2.1) that 


a= All ebe ee ee 


[zo]? 


This proves that f is continuous at x. 


From Proposition 2.1, it follows immediately that continuity is preserved when 


we perform certain operations on functions. 


Proposition 2.12 


Let D be a subset of real numbers that contains the point 79. Given that the 


functions f : D — Rand g: D — Rare continuous at xo. 


1. For any constants a and (, the function af + 6g : D — Ris continuous 


at Xo. 


. The function (fg) : D > R is continuous at xo. 


_ If g(x) # 0 for all « € D, then the function (f/g) : D — 


continuous at Zo. 


For composition of functions, we have the following which is a counterpart of 
Proposition 2.4. 
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Proposition 2.13 


Given the two functions f : D > Randg:U —> R with f(D) CU. If xo 


is a point of D, f is continuous at xo, g is continuous at yo = f(x), then 


the composite function (g o f) : D > R is continuous at zo. 


This proposition can be proved easily using definition of continuity in terms 


of convergent sequences. 


Corollary 2.14 


Let D be a subset of real numbers that contains the point xo. If the function 


f : D => Riis continuous at xo, then the function |f| : D — R is also 
continuous at Zo. 


Let us now look at an example of a piecewise function. 


Example 2.18 


Let f : [—2,3] — R be the function defined by 


ee 3 a 


cx + 2, it l<eed 


Show that there is a value of c for which f is a continuous function. 


Solution 
The domain of the function f is D = [—2,3]. First we show that if a € 
D\ {1}, then f is continuous at x. 
If zo € [—2,1), then zp < 1. If {x,} is a sequence in D \ {xo} that 
converges to X, then there is a positive integer NV such that x, < 1 for all 
n > N. This implies that for alln > N, f(r,) = 2x? — 3. Hence, the 


sequence { f(xz,)} converges to f(x) = 2x9 — 3. This proves that f is 


continuous at Zo. 
Using similar arguments, we can show that if 7) € (1,3], f is continuous 


at Zo. 


Chapter 2. Limits of Functions and Continuity 110 


Now, by definitions of left limits and right limits, 


lim f(z) = lim (22 — 3) = -1; 


’ 
x2—1- x1- 


lim f(x) = lim (cr + 2) =c+42. 


x—1t xz1t 


For f to be continuous at xp = 1, lim f(x) must exist. So we must have 
t-> 


liieey (2: ) = mia (ae 


r= zit 


This gives c = —3. In fact, when c = —3, 


lim f(x) = —1 


x1 


and hence f is continuous at x = 1. 


Figure 2.5: The function defined in Example 2.18. 


Chapter 2. Limits of Functions and Continuity 111 


Remark 2.2 

We can formulate a general theorem from Example 2.18 as follows. 

Let D be a subset of real numbers that contains the point xo, and let D,,, — 
and D,,,.+ be the intersection of D with the sets {x |x < xo} and {x|x > 


xo} respectively. Suppose that zo is a limit point of both D,,,- and D,,.+, 


and f : D — Risa function such that its restrictions to D,,— and Dy, + 


are continuous. If 


lim f(x) = lim, f(x) = f(x), 


L>Lo L>Xo 


IR is a continuous function. 


Finally, we define a special class of continuous functions called the Lipschitz 
function. 


Definition 2.8 Lipschitz Function 


Let D be a subset of real numbers. A function f : D — R is said to be a 
Lipschitz function if there is a constant c such that 


|f (x1) — f(x2)| < elxi — ro| for all 71,22 € D. 


The constant c is called a Lipschitz constant of the function. 


Notice that a Lipschitz constant is nonnegative. The only Lipschitz functions 
with 0 Lipschitz constant are the constant functions. If co is a Lipschitz constant 


of a Lipschitz function f : D — R, any number c that is larger than co is also a 


Lipschitz constant of /. 


Example 2.19 


Let f : R > R be the function given by f(x) = ax +b. Then f isa 


Lipschitz function with Lipschitz constant |a]. 
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Example 2.20 


Let f : [—10, 8] — R be the function defined by f(x) = x. Show that f is 
Lipschitz. 


Solution 
For any 2, and x2 in [—10, 8], 


If (x1) — f(v2)| = lat — 23 = |r + 29||ay — a9]. 
Triangle inequality implies that 


Hence, 
|f (21) — f(%2)| < 20|x, — zl. 


This shows that f is a Lipschitz function with Lipschitz constant 20. 


Example 2.21 


Let f : R — R be the function defined by f(x) = x”. Is f a Lipschitz 
function? 


Solution 
If f is a Lipschitz function, there is a positive constant c such that 


iva) =f (vo)| elz1 — x5 


for all real numbers x; and x2. Take 7; = c+ 1 and x2 = O. We find that 


(c+ 1)° = |f (21) — f(e2)| < ele — 22| = e(e + 1), 


which implies that c+ 1 < 0, a contradiction. Hence, f is not a Lipschitz 
function. 


Here we see that whether a function is Lipschitz or not depends on the domain. 
Finally we prove that a Lipschitz function is continuous. 
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Theorem 2.15 


Let D be a subset of real numbers. If f : D — R is a Lipschitz function, 


then it is continuous. 


Since f : D — R 1s Lipschitz, there is a positive constant c such that for 


any x; and x2 in D, 


file RG Sere, nh 


Let xo be a point in D. Given < > 0, take 6 = ¢/c. Then 6 > 0 and for any 
x € D, if |x — x| < 6, 


|f(x) — f(xo)| < cla — xo| < cd =e. 


This proves that f is continuous at 79. Hence, f : D — R is a continuous 


function. 
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Exercises 2.2 


Question 1 


Consider the function f : R — R defined by 


Ua eh, 
ife<2- 


Show that f is a continuous function. 


Question 2 


Consider the function f : R — R defined by 


if x is rational, 


if x is irrational. 


Show that f is continuous at x = 0. 


Question 3 


Consider the function f : R — R defined by 


22 +5, ita 


ax? + 2, ifx>—1_ 


Show that there is a value of a for which f is a continuous function. 


Question 4 


Let f : [—7,5] — R be the function defined by f(x) = 2x? + 3x. Show 
that f is a Lipschitz function. 


Question 5 


Let f : [1,00) > R be the function defined by f(a) = \/x. Show that f is 
a Lipschitz function. 
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2.3. The Extreme Value Theorem 


For a real-valued function f : D — R, the maximum value is the largest value the 
function can assume; while the minimum value is the smallest value the function 


can assume. 


Definition 2.9 Maximium and Minimum Values of a Function 


Let D be a subset of real numbers. Given that f : D — R is a real-valued 
function defined on D. 


1. f has a maximum value if and only if there is a point x in D such that 
G2 Seat) for all x € D. 
Such a 2 1s called a maximizer of the function f. 
2. f has a minimum value if and only if there is a point xo in D such that 
a en) for all x € D. 


Such a 2 1s called a minimizer of the function f. 


Extreme Values 


The maximum value of a function f : D — R is the maximum of the set 


f(D); while the minimum value is the minimum of the set f(D). 
A maximum value or a minimum value of a function is called an extreme 
value of the function. 


Example 2.22 


(a) For the function f : [—1,2] > R, f(a) = 2x, D = [-1, 2] and f(D) = 
[—2, 4]. Thus, f has minimum value —2 and maximum value 4. 


(b) For the function g : [—1,2) > R, g(a) = 2x, D = [—1, 2) and g(D) = 
[—2, 4). Thus, g has minimum value —2, but it does not have maximum 
value. 
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(c) For the function h : (—1,2] > R, h(x) = 22, D = (-1,2] and 


h(D) = (—2,4]. Thus, h has maximum value 4, but it does not have 


minimum value. 


y y y 


(a) fix) (b) g(x) (c) A(x) 


Figure 2.6: The functions f(a), g(a) and h(a) defined in Example 2.22. 


Example 2.22 shows that the existence of extreme values depends on the 
domain of the function. 

For a set to have maximum and minimum values, it is necessary (but not 
sufficient) that the set is bounded. Let us first define what it means for a function 
to be bounded. 


Definition 2.10 Bounded Functions 


We say that a real-valued function f : D — R is bounded if its range f(D) 
is bounded. In other words, a function f : D — R is bounded if and only 


if there is a positive constant V/ such that 


lf(z)| <M for all x € D. 


Example 2.23 


All the three functions defined in Example 2.22 are bounded. 


We are interested in a sufficient condition for a continuous function to have 


maximum and minimum values. Before we proceed, let us look at two examples. 
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Example 2.24 


; 1 
Consider the function f : (0,1) — R defined by f(x) = —. Although the 
zi 


domain of the function D = (0,1) is bounded, the range of the function 
f(D) = (1, ov) is not bounded. 


This example shows that a continuous function does not necessarily map a 
bounded set to a bounded set. 


Example 2.25 


Consider the function f : [1,0oo) — R defined by f(a) = —. Although 


the domain of the function D = [1, co) is closed, the range of the function 
f(D) = (0, 1] is not closed. 


This example shows that a continuous function does not necessarily map a 
closed set to a closed set. 

The situation changes when we combine closed and bounded. Recall that 
we have defined the concept of sequential compactness in Chapter 1, Section 
1.8. A set D is sequentially compact if every sequence in D has a subsequence 
that converges to a point in D. We have proved that a subset of real numbers is 
sequentially compact if and only if it is closed and bounded. 

The following theorem says that a continuous function maps a closed and 
bounded set to a closed and bounded set. 


Theorem 2.16 


Let D be a closed and bounded subset of IR. If f : D — R is a continuous 


function, then the set f(D) is closed and bounded. 


Using the fact that a subset of real numbers is sequentially compact if and only 
if it is closed and bounded, Theorem 2.16 is equivalent to the following. 


Theorem 2.17 


Let D be a sequentially compact subset of R. If f : D — R is a continuous 


function, then the set f(D) is sequentially compact. 
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We use the definition of sequential compactness to prove this theorem. Let 
{Yn} be a sequence in f(D). We need to prove that there is a subsequence 


of {y,} that converges to a point in f(D). 


For each positive integer n, since y, is in f(D), there is an x, in D such 
that f (an) = Yn. This gives a sequence {x,,} in D. Since D is sequentially 
compact, there is a subsequence {z,,, } of {x,,} that converges to a point 
xo in D. Since f is continuous at xo, the sequence { f(,,,)} converges to 
f (o). In other words, we have shown that the subsequence {y,,, } of {yn} 
converges to the point f(x) in f(D). 


Proving Theorem 2.16 without using sequential compactness is tedious, and it 
essentially goes through some of the arguments used to prove that a subset of real 
numbers is sequentially compact if and only if it is closed and bounded. From 
here, we can see the usefulness of the concept of sequential compactness. 

In Theorem 1.47, we have seen that a set that is closed and bounded must 
have a maximum and a minimum. Hence, we obtain immediately the following 


theorem. 


Theorem 2.18 Extreme Value Theorem 


Let D be a closed and bounded subset of IR. If f : D — R is a continuous 


function, then f has a maximum value and a minimum value. 


Corollary 2.19 


If f : [a,b] + Ris a continuous function defined on a closed and bounded 


interval, then f is bounded, and it has a maximum value and a minimum 
value. 


Extreme value theorem is used to guarantee the existence of a maximum value 
and a minimum value before we proceed to find these values, so that the attempt 
to look for extreme values is not futile. In some circumstances, knowing the 


existence of such extreme values is sufficient. 
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Example 2.26 


Show that the function f : R — R defined by 
f(z) = |x —1]+4+ |x — 2| + |x — 3] 4+ |x — 4] + |2 —5] 
has a minimum value. 


Solution 
In this example, the domain of the function is not closed and bounded. We 
cannot apply the extreme value theorem directly. However, we can proceed 


in the following way. First, we justify that the function f : R —> R is 
continuous. A function of the form g(a) = x — a is continuous since it 
is a polynomial. Absolute value of a continuous function is continuous. 
Hence, a function of the form h(x) = |x — al is continuous. Being a sum 
of continuous functions, f (2) is a continuous function. 


To prove the existence of a minimum value, we notice that for 7 > 5, 
f(z) =x2-1l+2-24+2-3+2-44+2-5=52-15>10. 
For z < 1, 


f(w)=1—24+2-274+3-274+4-24+5-2=15-52 > 10. 


Now restrict the domain to [1,5], the function f : [1,5] — R is continuous. 


Hence, it has a minimum value at some po € [1,5]. It follows that 
Fpl fe) for all x € [1, 5]. 


In particular, 


This proves that for all x € | 


R has a minimum value. 


Chapter 2. Limits of Functions and Continuity 120 


Exercises 2.3 


Question 1 


Determine whether the function is bounded. 


x 


(a) f: RR f( eee 


(b) f:(0,1) +R, f@)=2t—. 


Question 2 


If a function f : D — R is continuous and bounded, does it necessarily 


have a maximum value and a minimum value? Justfiy your answer. 


Question 3 


Let f : [—4, 4] — R be the function defined by 


ap eae 


Ie) = reg 


Show that it has a maximum value and a minimum value. 
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2.4 The Intermediate Value Theorem 


In this section, we are going to discuss the intermediate value theorem, which is 
an important theorem for continuous functions. It is essentially a theorem about 


existence of solutions for equations defined by continuous functions. 


Theorem 2.20 Intermediate Value Theorem 


Given that f : [a,b] — R is a continuous function. For any real number w 


that is between f(a) and f(b), there exists a point c in [a, b] such that 


The proof is using bisection method, which provides a constructive way to 
find the point c. 

Without loss of generality, assume that f(a) < w < f(b). 

We construct two sequences {a,,} and {b,,} recursively. Define a, = a, 


b, = 6, and let 
ay + by 
2 
be the midpoint of a, and b;. The interval [a,b] = |[a,, b;] is bisected into 


Ka = 


two subintervals [a,, 7] and [7m, b;| by the point m,. 
We want to define the interval [a2, bz] to be one of these, based on the value 
of f (m1). 


e If f(mi) < w, define ag = m, and by = by. 
e If f(m,) > w, define ay = a; and bp = mj. 


By definition, 
ay Sag < bp Shy, 


f(a2) <w < f(b), 


and the length of the interval [a2, b] is half the length of the interval [a1, bj]. 
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Suppose that we have defined a1,...,@n, 61,..., bn, such that 


Cig Oe Oy Os Ot ey ee 


(Ei ene Se asian) forall l <k <n, 


and 


bp_-1 — Ane 
<9. foral2<k <n. 


Let 


An + bn 
Re 
2 


be the midpoint of a,, and by. 


e If f(mn) < w, define an41 = my and by41 = dp. 


e li fGn,) mw, define.a,.7.—a,,and o,. — 111,. 


By definition, 


an SS An+1 < Bn+4 = ee 


eresy <Cives PA Dieids 


and 
by, — Gn 
2 


This constructs the sequences {a,} and {b,}. Notice that {a,} is an 


Ore = Cpe = 


increasing sequence that is bounded above by 6, while {b,,} is a decreasing 
sequence that is bounded below by a. 
By monotone convergence theorem, the sequence {a,,} converges to a 
number c; = sup{a,} and the sequence {b,,} converges to a number 
Co = inf{b,,}. By induction, we find that 

b—a 


On — An = Qn-1" 
Taking n — oo limits, we conclude that 


C2 —c, = 0. 


Chapter 2. Limits of Functions and Continuity 123 


It follows that the number c = c; = cp satisfies 
Gy eb, for alln € Zt, (2.2) 


and 


ied! (5 — 6" nani (2.3) 
nN oo n—- Ooo 


Eq. (2.2) shows that c is in [a, b]. The continuity of the function f and (2.3) 
implies that 


ie — Ta, et Oe 


N—->Co n—- co 


Since 


fe | and yf (be for all n € Zt, 


we find that 
fle) <w NG) 2a 


This proves that f(c) = w, and hence completes the proof of the theorem. 


Figure 2.7: The intermediate value theorem. 


The following is an example which we use the intermediate value theorem to 
justify that an equation has a solution. 
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Example 2.27 


Show that the equation 
z°+6r+1=0 


has a real root. 


Solution 


Let f(x) = 2° + 6x + 1. Since f(x) is a polynomial, it is a continuous 


function. Notice that 


Hence, f(—1) < 0 < f(0). Namely, 0 is a value between f(—1) and f(0). 
By intermediate value theorem, there is a point c in the interval (—1, 0) such 
that f(c) = 0. Then x = cis a root of the equation 


go +6r2+1=0. 


In this solution, the choice of a = —1 and b = 0 are by trial and error. 
In practice, one can use a computer to sample some xz values and calculate the 
corresponding values of f(a). The goal is to find a and b such that f(a) and f(b) 
have oppositive signs. To calculate the root c, one can implement the bisection 
method numerically. 


Example 2.28 


Let n be a positive integer, and let c be a positive number. Use the 


intermediate value theorem to show that there is a positive real number 


x such that 
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Solution 
Take a = 0, b = c+ 1, and consider the function f : [a,b] + R defined by 
ce) ae Shien, 


ie) 0) 0 
fb) = flerl)=(+e)" 2 l+nese 


Hence, 
f(a) <e< f(®). 


Since f is a continuous function, intermediate value theorem asserts that 
there is a number z in the interval [0,c + 1] such that f(z) = a" =c. 


In Chapter | Example 1.7, we use completeness axiom to solve this problem 
when n = 2 and c = 2. Here we use the intermediate value theorem to tackle the 
general problem. The tedious part has been settled in the proof of the intermediate 
value theorem. 

In the following, we want to formulate a precise relation between intervals and 


the intermediate value theorem. We first introduce a concept called convexity. 


Definition 2.11 Convex Sets 

Let S be a subset of real numbers. We say that S is convex if for any u and 
vin S, (1—t)u+ tvisin S for all t € (0, 1]. 

Equivalently, S is convex provided that whenever u and v are in S and 


u < v, then any w in the interval |w, v] is also in S. 


The equivalence of the two definitions is seen by observing that when t changes 
from 0 to 1, (1 — t)u + tu goes through all the points in the interval |u, v]. 


Obviously, an interval is a convex set. The converse is also true. 


Theorem 2.21 


Let S' be a subset of real numbers. If S is a convex set, then S is an interval. 
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Sketch of Proof 

If S is bounded below, let a = inf S. Otherwise, set a = —oo. If S is 
bounded above, let b = sup S. Otherwise, set b = oo. 

If c is a point in (a,b), then a < c < b. In particular, since c > a, it is not 
a lower bound of S. Hence, there is a point u in S such thata < u < ¢. 
Since c < b, cis not an upper bound of S. Hence, there is a point v in S 
such that c < v < b. Since u and v are in S and S is convex, all points in 
the interval [u,v] are in S. By construction, u < c < v. Hence, c is in S. 
This proves that all the points in (a, b) are in S. 

Finally, we just need to consider whether S contains a, and whether it 


contains b. 


Convex Sets and Intervals 
Let S be a convex set. If S is bounded below, let a = inf S. If S is bounded 
above, let b = sup S. 


1. If S is bounded, S does not contain inf S and sup S, then S = (a, b). 


2. If S is bounded, S contains inf S but does not contain sup S, then S = 
[a, b). 


. If S is bounded, S contains sup S but does not contain inf S, then S = 
(a, b]. 


. If S is bounded, and S' contains both inf S' and sup S, then S = [a, }j. 


. If S is bounded below but not bounded above, and S does not contain 
inf S, then S = (a, o«). 


. If S is bounded below but not bounded above, and S contains inf S, then 
S = a,c). 


. If S is bounded above but not bounded below, and S does not contain 
sup S, then S = (—oo, b). 
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8. If S is bounded above but not bounded below, and S contains sup S, 
then S = (—co, }]. 


9. If S is not bounded above nor bounded below, then S = (—oo, co) = 


The following is a reformulation of the intermediate value theorem. 


Theorem 2.22 Intermediate Value Theorem 


Let J be an interval. If the function f : J — R is continuous, then f (J) is 


an interval. 


To show that f(/) is an interval, take two distinct points u and v in f(J). 
We need to show that any w in between u and v is in f (J). Since u and v are 
in f(Z), there exist a and bin J such that u = f(a) and v = f(b). Without 
loss of generality, assume that a < b. Since J is an interval, it contains the 


interval [a,b]. Since f is continuous on [a, 6], and w is in between f(a) and 


f(b), the version of the intermediate value theorem that we have proved 
implies that there is a point c in the interval (a, b) such that f(c) = w. This 
shows that w is also in f (J). 
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Exercises 2.4 


Question 1 


Show that the equation 2x + Vz? + 1 = 0 has a real solution. 


Question 2 


Given that f : [—2,10] — [—2, 10] is a continuous function. Show that 
there is a point x in the interval [—2, 10] such that f(x) = x. 


Question 3 


Suppose that f : R — Ris a bounded continuous function. Show that there 
is areal number « such that f(a) = x. 


Question 4 


Let n be an odd positive integer, and let 


P(©) = Anz” + An1v" | +++++a12 + a9 


be a polynomial of degree n. Show that p(x) = 0 has a real root. 
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2.5 Uniform Continuity 


In Section 2.2, we have defined the concept of continuity at a point. This is a 
local property which only depends on the function value in a neighbourhood of 
a point. In this section, we want to define a concept called uniform continuity, 
which depends on the behaviour of the function on the whole domain. Such a 


property is called a global property. 


Definition 2.12 Uniform Continuity 


Let D be a subset of real numbers. A function f : D — R defined on D is 


uniformly continuous provided that for any ¢ > 0, there exists 0 > 0 such 


that if 7, and x2 are in D and |x; — x| < 6, then 


ei faa) <a 


Theorem 2.23 Equivalent Definition of Uniform Continuity 


Let D be a subset of real numbers. A function f : D — R defined on D is 


uniformly continuous if and only if whenever {w,,} and {v,, } are sequences 
in D such that 


lim (Un — Un) = 0, 
noo 


{f(un)} and { f(v,)} are sequences in f(D) such that 


lim (Fun) — f(»)) = (0. 


noo 


Notice that we only require the sequence {u,, — v,,} to converge to 0. We do 
not require the sequence {w,,} nor the sequence {v,,} to be convergent. 

Theorem 2.23 can be proved in the same way as we prove the equivalence of 
two definitions for limits of functions. 


The following is quite obvious. 


Theorem 2.24 


Let D bea subset of real numbers. If f : D — Risa uniformly continuous 


function, it is continuous. 
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Let us compare the definitions of continuity and uniform continuity using the 


definitions in terms of ¢ — 0. 


Continuity versus Uniform Continuity 


e A function f : D > R is continuous if 


Vao € D, Ve > 0, 36 > 0, Va € D, |x—-a9| << 6 = > |f(x)—f(zo)| <e. 


e A function f : D > R is uniformly continuous if 


Ve > 0, dd > 0, Vato € D, Va € D, |x—-a9| < 6 => |f(x)—f(zo)| <e. 


The difference is in the order of the quantifiers. For a function to be continuous, 
it must be continuous at each point in the domain. For each point xo in the domain, 
there should exist a positive 6 for each positive ¢. This number 6 not only depends 
on €, but also on the point x9. For uniform continuity, one needs to be able to find 
a 6 which only depends on ¢ but not on the point in the domain. This is where the 
uniformity lies. 

Let us look at some examples of functions that are continuous but not uniformly 
continuous. 


Example 2.29 


1 ; 
Show that the function f : (0,1) — | — is not uniformly 
Ay 
continuous. 


Solution 
For a positive integer n, let 


1 1 
n+1’ ae? 


Un 


Then {u,,} and {v,,} are sequences in the domain D = (0, 1), and 


ib il 
lim (tp, — Un) = lim — lim =) 
N—+00 noo N + noo n+2 
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Since f(up,) =n + land f(v,) = n+ 2, we find that 


lim (f (un) — f(vn)) =-1 4 0. 


NCO 


Hence, f is not uniformly continuous. 


Example 2.30 


Show that the function f : (0,00) — | is not uniformly 


continuous. 


Solution 
For a positive integer n, let 


Un =n+—, On = Ms 
n 


Then {u,,} and {v,,} are sequences in the domain D = (0, 00), and 


we find that 
lim (f(tn) — f(Un)) = 240. 


nN—-Co 


Hence, f is not uniformly continuous. 


If we change the domain of the function, the conclusion is different. 
Example 2.31 


Let f : [—10, 8] — R be the function defined by f(x) = x. Show that f is 


uniformly continuous. 
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Solution 


In the solution of Example 2.20, we have shown that for any x; and x» in 
the domain D = [—10, 8}, 


lf (21) — f(%2)| < 20|x, — zl. 


Given « > 0, take 6 = ¢/20. Then 6 > 0. If x; and x2 are in D and 
|v. — L2| < 6, then 


|f(x1) — f(x2)| < 206 =e. 


This proves that f is uniformly continuous. 


Example 2.31 is a function that is Lipschitz. In fact, the proof of Theorem 2.15 
can be easily modified to prove that a Lipschitz function is uniformly continuous. 


Theorem 2.25 


Let D be a subset of real numbers. If f : D — R is a Lipschitz function, 


then it is uniformly continuous. 


The converse is not true. For example, the function f : [0,1] > R, f(a) = /x 


is not Lipschitz, but it is uniformly continuous. We leave this to the exercise. 
In the following, we give a sufficient condition for a function to be uniformly 


continuous. 


Theorem 2.26 


Let D be a closed and bounded subset of real numbers. If f : D > 


continuous function, then it is uniformly continuous. 


To prove this theorem, we start with a technical lemma. 
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Lemma 2.27 


Let S' be a sequentially compact set in R, and let {a,,} and {b,} be two 


sequences in S. There is strictly increasing sequence of positive integers 
{71,N2,73,...} such that each of the subsequences {a,,,@n.,@n,,---} and 
{bn,; Ons; Ong,---} converges to a point in S. 


Using sequential compactness, we can guarantee that {a,,} has a subsequence 
that converges to a point in S, and {b,,} also has a subsequence that converges to a 
point in S. However, the indices of these two subsequences might not be related. 
We need to choose the subsequences carefully to make sure that the indices {n,} 
are the same. 


First, the sequentially compactness of S guarantees that there is a 
strictly increasing sequence of positive integers {ky, k2, k3,...} so that the 
subsequence {ax,,@k., Ak3,---} converges to a point a in S. For a positive 
integer 7, let 


C= Dy, 


Consider the sequence {c;} indexed by 7 € Z*. It is a subsequence of 
{b,,}, and it is also a sequence in S. Since S is sequentially compact, there 
is a strictly increasing sequence of positive integers {J1, j2, j3,...} such 


that the subsequence {c;,,Cj.,Cjg,---} = {Dkj, > Dkejy » Obey 


...} converges 
to a point b in S. For a positive integer m, let n,», = k,,,. Then 
{n1,N2,N3,...} is a strictly increasing sequence of positive integers. 
The sequence {0,,,,0n,,0,.,---) 18 a subsequence of {0;,.a;..0;,,---}- 
Hence, it converges to a. The sequence {b,,,, bn, bn3,-.-} is the sequence 
{5 , Cjo, Cjz,---} Which converges to b. 


Now we return to the proof of Theorem 2.26. 
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Proof of Theorem 2.26 
We use proof by contradiction. If f is not uniformly continuous, there is an 
€ > O such that for all 6 > 0, there are points u and v is D with |u — v| < 6 
and | f(u) — f(v)| > ¢. This implies that for each n € Z*, there are points 


ur, and v, in D with 


jin — Mal <= and | f (04m) — F(%m)] Be. 


Thus, {u,,} and {v,,} are two sequences in D such that 


lim (tpn — Up) = 0. (2.4) 


n—->co 
Since D is closed and bounded, it is sequentially compact. By Lemma 


2.27, we find that there is a strictly increasing sequence of positive integers 
{n1, 2,3, ...} so that the subsequence {w,,, } converges to a point uo in D; 


and the subsequence {v,,,} converges to a point vp in D. Since f: D> R 
is continuous, the sequence { f (un, )} converges to f (uo), and the sequence 
{ f (Un, )} converges to f (vo). By construction, 


|f(un,) — f(vn,)| > € for all k € Zt. 


This implies that 
|f(uo) — f(vo)| 2 €. 


Since {tn — Un, } is a subsequence of {up — Un}, (2.4) implies that 
Uo — Vo = lim (Un, — Un,) = 0. 
k-o0 


In other words, wp = vo. Then we should have f(uo) = f(vo), which 
contradicts to | f (uo) — f(vo)| => ¢. We conclude that f must be uniformly 
continuous. 


Example 2.32 


Show that the function f : (0,100) — | «x is uniformly 
continuous. 


Using the definition of uniform continuity to solve this problem is tedious. 
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Solution 
The domain of the function D; = (0,100) is not closed and bounded. We 
cannot apply Theorem 2.26 directly. Consider the function g : [0,100] > R 


defined by g(x) = ,/z. It is a continuous function. Since the domain 
D, = [0, 100] is closed and bounded, g is uniformly continuous. 
Since f : (0,100) — R is the restriction of the function g to Dr, it is also 


uniformly continuous. 


Exercises 2.5 


Question 1 


Determine whether the function f : [0,00) > R, f(x) = 22? + 3x is 


uniformly continuous. 


Question 2 


Show that the function f : (0,20) > | = - is uniformly 


continuous. 


Question 3 


Let f : [0,1] — R be the function defined by f(x) = \/x. Show that f is 
not Lipschitz, but it is uniformly continuous. 


Question 4 


i 
Determine whether the function f : (0,1) >| —= is uniformly 


Jz 


continuous. 
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2.6 Monotonic Functions and Inverses of Functions 


In this section, we study monotonic functions. 


Definition 2.13 Monotonic and Strictly Monotonic Functions 


Let D be a subset of real functions and let f : D — R be a function defined 
on D. 


1. We say that f : D — Ris an increasing function if for any x; and x2 in 
Dy, 


ta 


. We say that f : D > Ris astrictly increasing function if for any x, and 


zt in D, 


w<%2 => f(x1) < f(x2). 


. We say that f : D — Ris a decreasing function if for any x; and x2 in 
D, 


(i) fea), 


. We say that f : D > R is a strictly decreasing function if for any 71 


and x2 in D, 
%<x¢%p SS f (21) = Hil@ale 


. We say that f : D > Ris monotonic if it is increasing or it is decreasing. 


. We say that f : D — R is strictly monotonic if it is strictly increasing 


or it is strictly decreasing. 


The following is obvious from the definitions. 


Proposition 2.28 


Let D be a subset of real functions and let f : D — R be a function defined 


on D. If f is strictly monotonic, then it is one-to-one. 
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Example 2.33 


(a) Let f : [—3, 4] > R be the function defined by 


i os 
i 7 Oe 4 


It is an increasing function. 


(b) Let g : [—3,4] > R be the function defined by 


ie ee 
| Se. Wiig eh 


It is a decreasing function. 


Neither f nor g is strictly monotonic. 


S 


(a) fx) (b) g(x) 


Figure 2.8: The functions f(a) and g(x) defined in Example 2.33. 
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Example 2.34 


(a) Let f : (—oo, 0] > R be the function defined by f(x) = x”. Then f is 
strictly decreasing. 


(b) Let g : [0,co) — R be the function defined by g(x) = x”. Then g is 
strictly increasing. 


0 0 
(a) f(x) (b) g(x) 


Figure 2.9: The functions f(x) and g(x) defined in Example 2.34. 


Figure 2.10: An increasing function with a jump discontinuity. 


The following is a characterization of the discontinuities of a monotonic function. 
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Theorem 2.29 


R be a monotonic function. For any 29 in (a, bj, the left 


f-(xo) = lim f(z) 


L>XLo 


exists. For any Xo in [a, b), the right limit 


f,(%0) = lim, f(z) 


I+Xo 


exists. Define 
f-(a)= f(a) and f,(b) = f(0). 


Then the function f : [a,b] + R is continuous at the point xo in [a, b] if and 


only if 
f-(x0) = f(®0) = f4(o)- 


Otherwise, f has a jump discontinuity at x) with jump 


fey) ean) 


If f is decreasing, then —f is increasing. Hence, we only need to consider 


the case where f : [a,b] — R is increasing. Fixed x9 in (a, b]. Define the 
nonempty set S_ by 


Ae eS oh ea 


Since f is increasing, f(x) < f(xo) for any x in [a, 79). Therefore the set 
S_ is bounded above by f(xo). Let u = sup S_. Then u < f(x). We 
claim that 


u= lim f(x) = f-(o). 


I+Xy 


Given ¢ > 0, u—e < wand thus it is not an upper bound of S_. Hence, 


there is a point x, in [a, 79) such that 


f(@1) >u-e. 
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Let 6 = x9—2,. Then 6 > 0. If xis a point in [a, xq) such that |~—xo| < 0, 
then x; < x < 2%, and thus 


u—ée< f(t) < fle) <u. 


From this, we have 
|f(z) —ul <e. 


This proves that 
f-(eo) = lim f(x) =u. 


L>Ly 
Using similar argument, we find that for any xo in [a,b), the right limit 


lim f(a) exists, and 
road 


fs(0o) = lim, f(z) = inf {f(0) | 20 < @ <b}. 


L>Lo 


By definition of continuity, the function f is continuous at xo if and only if 
f_(xo) = f, (ao). The statement about the jump is obvious. 


Corollary 2.30 


Let J be an interval. If f : J + Ris monotonic, then f is continuous if and 
only if f(Z) is an interval. 


If f : J + Ris continuous, intermediate value theorem implies that f (J) is 


an interval. 


If f : J > Ris not continuous, Theorem 2.29 implies that there is a point 
Xo in the interval J for which either f_ (xo) A f(xo) or f+ (a0) A f (xo). In 
any case, f(/) cannot be an interval. 


For a function f : J — R defined on an interval J, we have seen that if f is 
strictly monotonic, it is one-to-one. It is true even if the function is not continuous. 
If we assume that the function is continuous, the converse is also true. It is a 
consequence of the intermediate value theorem. 
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Theorem 2.31 


Let f : J > R be a function defined on an interval J. If f is continuous 


and one-to-one, then f is strictly monotonic. 


If f fails to be strictly monotonic, there exist three points a, %, bin J such 
that a < % < band one of the following holds. 


(i) f(a) < f(b) < (xo) 
Gi) f(ao) < f(a) < f(0) 


Gii) f(a) > f(b) > F(o) 
(iv) f(ao) > f(a) > f(b) 


Consider case (i) where f(a) < f(b) < f(xo). Since w = f(b) is a value 
between f(a) and f(xo), intermediate value theorem implies that there is 
a point c in the interval (a,x9) for which f(c) = w. But then c # 6b, but 
f(c) = f(b). This contradicts to f is one-to-one. 

Using the same argument, we will reach a contradiction for the other three 
cases. This proves that f must be strictly monotonic. 


Now we consider invertibility of functions. We only consider functions that 
are defined on intervals. 


Definition 2.14 Invertibility of a Function 


Let J be an interval and let f : J — R be a function defined on J. The 
function f : J — Ris invertible if and only if it is injective. If f : 1 + Ris 
injective, its inverse is the function f~! : f(Z) — R defined in such a way 
so that 


f"Y)=2 = f(@)=y _ forall ye f(J). 
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Example 2.35 


Consider the functions f and g that are defined in Example 2.34. 


(a) The inverse of the function f : (—oo,0] — R, f(x) = 2”, is the 
function f~! : (0,00) + (—00, 0], f-'(x) = -vz. 


(b) The inverse of the function g : [0, co) > R, g(x) = 2”, is the function 
g-* : [0, 00) — [0, 00), g-*(a) = Vz. 


(b) 
Figure 2.11: The functions in Example 2.35. 


Notice that the inverse of a strictly increasing function is strictly increasing. 
The inverse of a strictly decreasing function is strictly decreasing. 
In the next theorem, we prove that the inverse of a continuous function is 


continuous. 


Theorem 2.32 


Let J be an interval and let f : J — R be a continuous function defined 


on I. If f : I > R is one-to-one, then f~! : f(I) > R exists, and it is 


continuous. 
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By Theorem 2.31, f is strictly monotonic. Without loss of generality, we 
assume that f is strictly increasing. 

Given a point yo in the interval f(/), let x) be the unique point in J such 
that f (20) = yo. Given © > 0, we need to prove that there is ad > 0 such 
that if y is a point in f(Z) with |y — yo| < 6, then | f~'(y) — f~1(yo)| < . 
For simplicity, assume that xo is an interior point of /. Then there isar > 0 
such that [% — 7, Zo +7] is in J. Take 


e) —Min2,7}s 


Then ¢; > 0, €) < €and [a — €1,%0 + &] C [to —17, 29 + 7] C I. Since f 


is strictly increasing, 
f(®o — €1) < f(%0) < f(ao + €1), 
and the interval | f(2o — €1), f(@o + €1)| isin f(). Let 
6 = min{f(xo) — f(xo — €1), f(xo + €1) — f (xo) f- 
Then 6 > 0. If y is a point in J such that |y — yo| < 0, then 
p= 21) to — 6 = 4 ye = ftp 21) 


This implies that y is also in f(I). Since f~' is strictly increasing, we have 


fo 6 Sop — 61 =f Y) x to ei Ss Do Pe. 


This implies that 
i) =i Goll, 


which completes the proof that f~! is continuous at yo. 
If f~'(yo) = Xo is an endpoint of J, we need to modify the proof a bit to 
show that f~! is continuous at yo. The details are left to the students. 
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Remark 2.3 


If J = (a,b) is an open interval and the function f : (a,b) > R is 


continuous and one-to-one, we have seen in Theorem 2.31 that f is strictly 
monotonic. In fact, one can prove that f (J) is also an open interval. 
Without loss of generality, assume that f is strictly increasing. Since f 
is continuous, f(/) is an interval. If f(J) is not an open interval, either 
inf f(Z) or sup f(Z) is in f(Z). If c = inf f(Z) is in f(J), there is a point 
u in (a,b) such that f(u) = c. But then wu > a and so wy = 1 * is also 
a point in (a,b). Since u; < u, f(ui) < f(u) = c. This contradicts to 
c = inf f(/). In the same way, one can show that sup f(/) is not in f(/). 
Hence, f (J) must be an open interval. 


Although we can use limits to show that when n is a positive integer, the 
function f(z) = </x is continuous, it is tedious. Using Theorem 2.32 is much 


more succint. 


Example 2.36 


Let n be a positive integer. 


1. If n is odd, the function f : R > R, f(x) = x” is continuous and one- 


to-one. Hence, its inverse f~! : R > R, f~'(x) = %/z is a continuous 


function. 


. If n is even, the function f : [0,00) + [0, 00), f(x) = x” is continuous 


x) 
and one-to-one. Hence, its inverse f~! : [0,0c0) > (0,00), f-'(x) = 


</x is a continuous function. 


Recall that a rational number r can be written as r = p/q, where p is an integer 
and q is a positive integer. For a positive real number x, we define x” by 


wae = (Ya) 


It is easy to check that the two expressions for x” are equal. Using the fact that 
composition of continuous functions is continuous, we obtain the following. 
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Theorem 2.33 


Let r be a rational number. 


1. Ifr > 0, f : (0,00) > [0,co), f(x) = a” is a strictly increasing 


continuous function. 


2. Ifr < 0, f : (0,00) > (0,co), f(z) = a” is a strictly decreasing 


continuous function. 


Exercises 2.6 


Question 1 


2x 


1 
Show that the function f : (—1,co) > R, f(x) = = is strictly 
z 


monotonic, and find the inverse function f~!. 
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Chapter 3 
Differentiating Functions of a Single Variable 


The simplest function is the constant function f(z) = c, whose function value 
does not vary with the input. The next class of functions that are relatively easy 
to study is a polynomial of degree one f(x) = ax + b, where a # 0. Sometimes 
we also call any function of the form f(x) = ax + bas a linear function, as its 
graph y = ax + bis a straight line in the xy-plane. However, this should not be 
confused with a linear function that are considered in linear algebra, which in the 
single variable case, refers to a function of the form f(x) = az. 


Definition 3.1 Graph of a Function 


If f : D — Risa function defined on a subset D of real numbers, its graph 


is the subset G; in R? defined as 


Gr={(e,y) |" € D,y= f(a)}. 


Jy y 
0 x 7 x - x 
(i) a<0 (ii) a=0 (ii) a>0 


Figure 3.1: The graph of the function f(x) = ax + b when (i) a < 0, (ii) a = 0 
and (iii) a > 0. 


For the function y = f(x) = ax + b, we find that for any two distinct points 
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Ly and X25 


f(%2)— f(t) — ale2—21) _ 


LQ — Ly LQ — Ly 


In other words, the change in the y values, 
Ay = y2— yi = f (x2) — f (x1) 
is proportional to the change in the z-values 
Ax = %2— 2}, 


with propotionality constant a. This constant a is called the rate of change of the 
function, and it is the slope of the line y = az + b. Its magnitude |a| characterizes 
how fast y is changing with respect to x, and its sign determine the way y changes. 
When a > 0, y increases as x increases. When a < 0, y decreases as x increases. 

For a function that is more complicated, such as a quadratic function y = 
f(x) = x”, we find that 


Ay = f (v2) — f(@1) = 23 — 2] = (2 + 41) (42 — £1) = (v2 + 21) Az. 


In this case, Ay/Az is not a constant. It depends on the points x; and x. 

In real-life scenario, functions are used to describe the dependence of a variable 
on the other. For example, if one wants to record the distance that has been 
travelled by an object, the independent variable is the time t, while the dependent 
variable is the distance s. In this case, one obtains a function s = s(t). The 
average speed the object is travelling between the time ¢ = ¢, and the time t = tz 
is 

8(t2) — s(t) 
to — ty 
In general, one cannot expect that this speed is a constant. If we are interested in 
the instantaneous speed that the object is travelling at time ¢ = ¢,, one can fix ¢1 
and take tz to be closer and closer to t;, and study the behaviour of the average 
speed. This leads to the concept of derivatives. 


3.1 Derivatives 


The derivative of a function y = f(a) is a measure of the rate of change of the y- 
values with respect to the change in the x- values. To be able to measure this rate of 
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change at a particular point xo, the function has to be defined in a neighbourhood 
of the point xp. Henceforth, when we define derivatives, we will assume that the 
function is defined on an open interval (a,b). This includes the case where a is 


—oo or 0 is oo. 


Definition 3.2 Derivatives 


Given a function f : (a,b) — R and a point zp in the interval (a,b), the 


derivative of f at x, is defined to be the limit 
jam £02) = £0) 
L2H ao Xo 


if it exists. If the limit exists, we say that f is differentiable at x, and its 
derivative a xo is denoted by f’(xo). Namely, 


Notice that in defining the derivative of a function f(x) at a point xo, the 
function that we are taking limit of is the function 


gia) — LOL). 


XL — Xo 


which is defined on the set D = (a,b) \ {ao}. It is easy to check that xo is 
indeed a limit point of the set D. The function g(x) is the quotient of the function 
p(x) = f(x) — f(a) and the function g(a) = x — xp. It is not defined at x = x 
since q(%) = 0. Moreover, since Jim q(x) = q(ao) = 0, a necessary condition 
for f to be differentiable at the point 2p is yn p(x) = 0, which says that the 


function f(x) is continuous at xo. 


Theorem 3.1 Differentiability Implies Continuity 


Let xo be a point in the open interval (a,b). If the function f : (a,b) - 


is differentiable at xo, it is continuous at xo. 
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If f is differentiable at 2, the limit 


Feces) 


L—>ZXo «w&— Xo 
exists. By limit laws, 
Hence, 


which proves that f is continuous at 2p. 


By writing 7 = x) +h, where h = x — po is the change in the x-values, we 


can write the derivative of a function f : (a,b) > R at a point 2 as 


m Jo +b) = Fo) 
- 


The continuity of the function f at the point 29 is then equivalent to 


lim f(x +h) = f(2o). 


Definition 3.3 Differentiable Functions 


We say that a function f : (a,b) > R is differentiable if it is differentiable 
at all points in (a,b). In this case, the derivative of f is the function f’ : 


(a,b) + R, where 


f (@) = lim 


h->0 


fla+h)— f@) 
; 


Let us look at the simplest example where f(x) = ax + b. 
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Example 3.1 


Let f : R — R be the function f(x) = ax + b. For any x and xo where 


x # Xo, we have 


f(a) — f(eo) _ 
«L— Xo 
This implies that 
Tose eee lbaelen) 


LX dG Abi) 


Hence, f is a differentiable function and its derivative is 


{@) =a for all z € R. 


Now let us look at a quadratic function. 


Example 3.2 


Let f : R — R be the function f(x) = x?. Show that f is differentiable 
and find its derivative. 


Solution 


For any real number z, 


— Gp 


This shows that f is differentiable and its derivative is f’(a) = 22. 


Finding derivative is finding the limit of 


f(z) — f(%o) 


Marq = 
XL — Xo 
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as x approaches xo. Since m,.;, is the slope of the secant line joining the two 
points (xo, f(xo)) and (x, f(x)) on the graph of the function, in the limit z > x0, 
we obtain a straight line that only touches the graph in a neighbourhood of the 
point (xo, f(vo)) at this point. This line is called the tangent line of the curve 
y = f(x) at the point (xo, f(xo)). 


bh 


y = yor f'(x0)(x — Xo) 
(xo, Vo) 


a 1 


y=fx) 


Figure 3.2: Derivative as slope of tangent line. 


Definition 3.4 Tangent Line 


Let xo be a point in the interval (a,b). If the function f : (a,b) > Ris 
differentiable at x , then the tangent line to the curve y = f(z) at the point 


(xo, f(2o)) is 


y =Yyo+ f (xo)(« — a0). 


Example 3.3 


We have found in Example 3.2 that the derivative of the function f(x) = x? 
is 7 (2) = 22, At the poimt ¢ = 3: /(3) = 9 and /' (3) = 6. Hence; the 
equation of the tangent line to the curve y = 2? at the point (3, 9) is 


y=9+4+6(2 —3) =62-9. 


Theorem 3.1 says that if a function f : (a,b) > R is differentiable at x, then 


it is continuous at x. A natural question to ask is whether the converse is true. 
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The answer is no, as shown by the following classical example. 


Example 3.4 


Consider the function f : R > R, f(x) = |x|. We have seen in Chapter 2 


that this is a continuous function. Let x9 be a point in R. 
Case 1: If x) > 0, then for any x in the neighbourhood (0,00) of xo, 
f(x) = |x| = z. It follows that 


tm 262) — fo) _ i E20 
LUG IG — Xo se 48) 46 — Xo 


=. 


This implies that f is differentiable at x9 and f’(xo) = 1. 
Case 2: If x) < 0, then for any x in the neighbourhood (—oo, 0) of 29, 
f(x) = |x| = —a. It follows that 


lim Fla) — £(@0) = lim 


xL—->XO GE = Xo xL—-XO IE = Xo 


ela) _ 


This implies that f is differentiable at xo and f’(xo) = —1. 
Case 3: When x9 = 0, we find that 


does not exist. Hence, f is not differentiable at x = 0. 


Graphically, we find that the curve y = |z| has a "sharp turn" at the point 
(0,0), and there is no well-defined tangent there (see Figure 3.3). 
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Figure 3.3: The graph of the function f(x) = |x| has a "sharp turn" at x = 0. 


Remark 3.1 Left Derivatives and Right Derivatives 


We can use left limits and right limits to define left derivatives and right 


derivatives. Let f : [a,b] + R be a function defined on the closed interval 
[a, 6). 


1. For any xo € (a, b], we say that the function is left-differentiable at xo 
provided that the left derivative at xo, f’ (xo), defined as the left limit 


exists. 


. For any xo € [a, b), we say that the function is right-differentiable at xo 


provided that the right derivative at x, f'. (ao), defined as the right limit 


Fao) = Jim 


exists. 


. For any xo € (a,b), f is differentiable at xo if and only if it is both left 
differentiable and right differentiable at xo. 


. We say that the function f : [a,b] — R is differentiable if it is 
differentiable at all xy € (a,b), right differentiable at a and left 
differentiable at b. 
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In the following, we will mainly discuss derivatives of functions defined on 
open intervals. The extension to closed intervals is straighforward by considering 
the one-sided derivatives at the end points. 


Example 3.5 Example 3.4 Revisited 


The function f(x) = |z| is left differentiable and right differentiable at 
x = 0, with 


P= ot 
It is not differentiable at « = 0 since f’ (0) # f/(0). 


Leibniz Notation for Derivatives 


d 
For the function y = f(x), its derivative f’(x) is also denoted by Fo 


d dx 
=f). 


For example, in Example 3.2, we have shown that 


— xy? = 2x. 


dx 


In the following, we are going to derive derivative formulas. The simplest 
derivative formula is the one for the function f(x) = x”, where n is a positive 
integer. 


Proposition 3.2 


Let n be a positive integer. The function f(x) = x” is differentiable with 
derivative 


We use the formula 


ape Za = (az = Die aii To, deo ee Jb Tine 4 in 


et (a) Nhen 
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L209 L— Xo 


lim (a) + 2" *¢9 +--+ +0057 + 26 *) 
L—>XoO 


-—1 -1 -1 —1 
fy AP deg, Fp Ome aay, ae Seg 
—_—_——— 

n terms 


ed n-1 
=NXy . 


Now let us look at the square root function. 


Example 3.6 


Determine the points where the function f : [0,00o) > | 
differentiable, and find the derivatives at those points. 


Solution 
First we consider the case where x9 > 0. When x > 0 and x ¥ x9, 


f(z) — (vo) _ V@— Vo _ — 
L— Xo L— Xo fx + ./20 


Hence, 


f' (xo) =" limi 


i br a4 10) 


1 
2/0 
For x9 = 0, we can only consider the right derivative. When x > 0, the 
formula (3.1) still holds. However, the limit 


This shows that f is differentiable at xo with derivative f’(xo) = 


does not exist. Hence, the function f(x) = ,/z is not differentiable at 


ze = (0, 
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Figure 3.4: The function f(x) = \/z is not differentiable at x = 0. 


Using limit laws, one can find derivatives of linear combinations, products and 
quotients of functions. 


Proposition 3.3 Linearity of Derivatives 


Let xo be a point in (a,b). Given that the functions f : (a,b) + R and 
g : (a,b) — R are differentiable at x9. For any constants a and /, the 


function af + Gg : (a,b) > Ris also differentiable at x) and 


(af + 8g)'(to) = af'(x0) + Bg'(a0). 


This is straightforward derivation from the limit laws. By assumption, we 
have 


Ee) 


)(a) = (af + Bg) (20) 


(oA) — F(@o) | ,9() - ute) 


ary) 
Ib —= 360) L— Xo 


Diy (ag) 


4b tim 962) = 9(@0) 
XL — Xo LX XL — Xo 


= af'(xo) + Bg’ (x0). 
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This formula can be extended to k functions for any positive integer k. If 


fi,.--, f~ are functions defined on (a,b) and differentiable at the point xo, then 
for any constants c;,...,c,, the function c, f; +...+ cf, is also differentiable at 
Xo, and 


(afi t+...+ ene)’ (#0) = afi (eo) +--+ caf, (Zo)- 


Proposition 3.4 Product Rule for Derivatives 


Let xo be a point in (a,b). Given that the functions f : (a,b) — R and 


g : (a,b) > R are differentiable at xo, the function (fg) : (a,b) > Ris 


also differentiable at xp and 


(f9)'(0) = f'(o)g(xo) + f(£o)g' (xo). 


Again, we are given that 


Since differentiability implies continuity, we have 


lim f(z) = f(xo) and lim g(x) = g(zo). 


thera 10) xL>XO 


Just like the proof of the product rule for limits, we need to do some 
manipulations. 


f(x) g(@) — f(@o)g(@o) = (F(@) — F(®o))9(xo) + F(a) (g(@) — 9(20)). 


It follows that 


(fg)'(xo) = lim CB) ge arn) giro) 


LX a () 


= tin, (Heaton 


+ ple O90 


L— Xo L— Xo ) 


(Xo 
xL—-XO 


= tim LILO) tin g(a + tim f(x) Jim gz) = 9(20) 


L—->X0 GE — 869) L—>x0 L209 Ib —" JEN) 


= f'(o)g(xo) + f(xo)g' (xo). 
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For a different perspective, we denote f(x) and g(a9) by u and v respectively, 
and let 


Au = f(x) — f(20), Av = g(x) — g(Zo). 
Then 


f(x)g(x) — f(@o)9(%o) = (u+ Au)(v + Av) — uv 


vAu +uAv + AudAv. 


After didiving by Ax = x—2o, the term AuAv/Az vanishes in the limit Ax — 0, 
and we obtain the product rule. 


General Product Rule 
The product rule for derivatives can be expressed as 
d du 


7 t’) ila +u— 


In general, when we have & functions uj, u2,..., Uz, the product rule says 


that 


d U du du 
Fy tua’ + UR) erieite: et (tatiana te t (ta ta) a. 


This can be proved by induction on k. 


Notice that the formula 
api =nx"!, wherene Zt 
dx 
d 
follows from the general product rule and age =, 
x 


Finally we turn to the quotient rule. 


Proposition 3.5 Quotient Rule for Derivatives 


Let x9 be a point in (a,b). Given that the functions f : (a,b) — R and 
g : (a,b) — R are differentiable at xo, and g(x) # O for all x in (a, b). 


Then the function (f/g) : (a,b) — R is differentiable at xo and 


) _ f'(eo)g(x0) — F(e0)9' (20) 
(Zo) 5 ; 
(Xo) 
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The assumption g(x) # 0 for all x in (a, b) is to make sure that the function 
f/g is well-defined on (a,b). In practice, we only need g(2o) # 0 and g is 
differentiable at xo. For then we find that g is continuous at xo. The assumption 
g(xo) # 0 will imply that g(a) # 0 in a neighbourhood of zp. 


First, notice that 


_ f(x)g(xo) — f(xo)g(x) 
g(x)g(xo) 
(f(x) — f(%0))9(x0) — f(%o) (g(x) — g(%o)) 
g(x)9(o) j 


Using the same reasoning as in the proof of the product rule, we obtain 


g(Xo)? 


Again, using the u and v notations, we have 


ut+tAu u_ (ut+Aujv—(v+Av)u — vAu—uAv 


v+Av v_ u(u + Av) — u(u+ Av) | 


This gives a different perspective on the quotient rule. 
Let us use the quotient rule to derive the derivative for f(x) = x”, when n is 


a negative integer. 


Proposition 3.6 


For any integer n, 
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We have proved the formula (3.2) when n > 0. When n < 0, let m = —n. 
Then m is a positive integer. By quotient rule, we have 


d ee eye ce 


n = dx dx 


= 6 = 
dx dx x™ gem 


Hence, the formula (3.2) also holds when n is a negative integer. 


Definition 3.5 Higher Order Derivatives 


If the function f : (a,b) > R is differentiable, its derivative f’ : (a,b) > 
IR is also a function defined on (a,b). We can investigate whether /’ is 


differentiable. If f’ is differentiable at a point xo in (a,b), we denote its 
derivative by f” (29), called the second (order) derivative of the function f 
at Xo. 

In the same way, we can define the n'"-order derivative of the function 
y = f(a) at a point xo for any positive integer n. We use the notation 

d"y 


(n) ces 
(Gal eee ne 


to denote the n'-derivative of the function y = f(x). It is defined 
recursively by 


Dye ae) eee) 


where by default, f (x) = f(x). 

We say that a function f : (a,b) > R is n times differentiable if f‘”) (2) 
exists for all x in (a, b). A function is infinitely differentiable if it is n times 
differentiable for any positive integer n. 


Example 3.7 


Polynomial functions are infinitely differentiable. Moreover, if the degree 
of a polynomial p() is n, then p) (x) = 0 forall k >n +1. 
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Example 3.8 


Define the function f : | R by 


ifz <1, 


pe ieee 
x 


Find the values of a and 6 so that f is differentiable. 


Solution 
The function f is differentiable at any point 29 in the interval (—oo, 1) or 
the interval (1, 00). 
For f to be differentiable, f has to be continuous and differentiable at 7 = 
1. For f to be continuous at 7 = 1, we must have 


lineal jg) == Lica ee), 


x1- feller 


This gives 
a=1+06. 


For f to be differentiable at x = 1, we must have 


Notice that 


Hence, we must have 


Solving for a and b, we have 
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Figure 3.5: The function f(x) defined in Example 3.8. 
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Exercises 3.1 


Question 1 


Define the function f : | R by 


ax? +2, thee oul, 


3 
x 


Find the values of a and 6 so that f is differentiable. 


Question 2 


Let xo be a point in (a, b). Given that f : [a,b] + Ris acontinuous function 
defined on [a, b] and differentiable at x9. Let g : [a,b] + R be the function 
defined by 


Ie) (So) 


Gane ie — oy: 


: if x € [a,b] \ {zo} 


Show that g : [a,b] + R is a continuous function. 


Question 3 
Let xo be a point in (a,b) and let f : (a,b) + R be a function defined on 
(a, 6). 


(a) If f : (a,b) — R is differentiable at x, show that 


ie ios kh) = f(to =f) 
h->0 2h 


(b) If the limit 
= f(to +h) — f(xo — A) 
h-0 De 
exists, is f necessarily differentiable at x9? 
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3.2. Chain Rule and Derivatives of Inverse Functions 


In this section, we are going to derive derivative formulas for composite functions 
and inverse functions. First we discuss a different perspective for differentiability 


of a function at a point. 


Differentiability 


Let xo be a point in the interval (a, b) and let f : (a,b) + R bea function 
defined on (a,b). If f is differentiable at x, then 


This implies that 


a f(to + h) — f (zo) — f'(zo)h 


h—0 h a 


Conversely, if there is a number c such that 


lim 2 (20 + 2) — Flo) = ch a 
h—+0 h 


0, 


limit laws imply that 


f(@o +h) — f(xo) 


h—0 h 


e= lim é 
This implies that f is differentiable at xo and f’(xo) = c. In other words, 
the function f is differentiable at x9 if and only if there is a number c such 
that 

lim f(to +h) eka —ch = 
Since xq € (a,b), there is an r > 0 such that (x) — r, 29 +r) C (a, 6). For 


a given real number c, let ¢ : (—r,1r) — R be the function defined by 


f(@o +h) — f(xo) — ch 
7 
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Then the differentiability of f at x9 is equivalent to lim ej.) =U, Hence, 
—y 


f : (a,b) > Ris differentiable at xo if and only if there is a number c and 


a function ¢(h) such that 


f(xo +h) = f(x) + ch + he(h), 


e(h) +0 whenh— 0. 


Theorem 3.7 Chain Rule 


Given that f : (a,b) — Rand g : (c,d) — R are functions such that 
f(a,b) C (c,d). If xo is a point in (a,b), f is differentiable at xo, g is 
differentiable at f(x), then the composite function (g 0 f) : (a,b) > Ris 


differentiable at x) and 


(90 f)' (wo) = 9'(F (x0) f'(@o). 


Since f is differentiable at x9 and g is differentiable at yo, we have 
lim €1(h) = 0 and lim €9(k) = 0. Let 
h->0 k-0 


k(h) = f(to +h) — f(%0) = f’(to)h + e1(h)h. 
Then by the definitions of ¢,(h) and €2(k), 


(9° f)(to +h) — (90 f)(®0) = g(yo + k(h)) — 9(yo) 
= 9' (yo) k(h) + €2(k(h))K(A) 
= g' (yo) f’(to)h + ea(h)h, 
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where k(h) 
ca(h) = of (yo)ea(h) + ea(h(h)) 


Since f is differentiable at xo, 


lim ED) == Minna (xo +h) — F(xo) 


aso A h—0 h 


= f'(x0). 


This implies that lim k(h) = 0. By limit law for composite functions, 
—> 


lim €9(k(h)) = lim €9(k) = 0. 


h-0 k-0 


Limit laws then imply that 


fim (02 P20 +) ~ (90 FY(20) = A wo) (OR _ ye 2) 0, 


h->0 h h->0 


This proves that the function g o f is differentiable at x9 and 


(go f)' (xo) = 9 (Yo) f' (xo) = 9 (f(x0)) f' (xo). 


Heuristically, if we let u = f(x) and y = g(u) = g(f(z)), chain rule says that 


dy dy du 

dx du dx’ 
which is the limit of 

Ay _ Ay y Au 

Ac Au’ Ax 


when Az —> 0. The rigorous proof we give above do not use this because we 
might face the problem that Au = f(x) — f (ao) can be zero even when x F 29. 


Example 3.9 


Let f : R > R be a differentiable function and let a be a constant. Show 


that the function g : R — R defined by g(x) = f(az) is differentiable, and 
g(x) = af'(ar). 
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Solution 
The function u : R > R, u(x) = az is differentiable with u(x) = a. By 
chain rule, the function g(x) = (f 0 u)(x) is also differentiable and 


Example 3.10 


Given that the function f : (0,2) —> | 
f'(1) = a, find the value of 


in terms of a. 


— tim (fo) = Fog) 


al ge = il 


Since g is differentiable at x = 1 and f is differentiable at g(1), chain rule 
implies that 


Recall that we have proved in Section 2.6 that if J is an interval, f : / > R 


is strictly monotonic and continuous, then f is invertible and f~' : f(I) > Ris 
also continuous. The strictly monotonicity is a necessary and sufficient condition 
for a continuous function to be one-to-one. If xo is a point in the interior of 
I, and f is differentiable at x), we can ask whether the inverse function f~* is 
differentiable at the point yo = f(x). Since (f~' o f)(x) = @ forall x € J, if 
f~' is differentiable at yo, chain rule implies that 


(f°) (Yo) F'(@0) = (FF (@0)) (#0) = 1. 


Therefore, a necessary condition for f—' to be differentiable at yo is f’(29) cannot 
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be zero. In the following theorem, we show that this condition is also sufficient. 


Theorem 3.8 Derivative for Inverse Function 


Let J be an open interval containing xo, and let f : J — R be a function 


that is strictly monotonic and continuous. If f is differentiable at xo and 
f'(xo) # 0, the inverse function f~! : f(I) — R is differentiable at yy = 
f (xo), and 


1 


cs )'(yo) i= fi(xo) 


The formula for (f~')/(yo) would follow from the chain rule if we know 
apriori that f—' is differentiable at yo. The gist of this theorem is to state that 
f~1 is indeed differentiable at yo. 


Without loss of generality, assume that f is strictly increasing. By Theorem 
2.32, f-' : f(1) > Ris also continuous. There is a 6 > 0 so that [x — 
6,%9 + 6] C I. Then (f(xo — 6), f(xo + 6)) is an open interval in f (J) 
containing the point yo. This implies that there is an r > 0 so that (yo — 
r,yotr) C f(Z). For any k € (—7,7r), let 


h(k) = f-"(yo + k) — f7* (yo). 


Then h is a strictly increasing continuous function of k and lim 0s 
Sy 
Notice that 


yo tk = f(to + h(k)). 


Therefore, 
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Hence, by limit laws for quotients and composite functions, we find that 


ie i Woe) en) 
k0 k 


— f!(xo)” 
This proves that f—! is differentiable at yo and 


1 


Co )'(yo) = f'(zo) 


As a corollary, we have the following. 


Corollary 3.9 


Let J be an open interval, and let f : J — R be a strictly monotonic 
differentiable function. If f’(2) 4 0 for all x € J, then the inverse function 
f-': f(D) > Ris also a strictly monotonic differentiable function with 


Example 3.11 


Let r be a rational number, and let f : (0,00) — R be the function f(x) = 
x". Show that f is differentiable and 


(LG) l= 
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Solution 
First we consider the case r = 1/n, where n is a positive integer. The 


'/” is the inverse of the function g(2) = x”, which is 


function f(x) = x 
differentiable and strictly increasing. Hence, f(x) = «'/” is differentiable 


and strictly increasing. Moreover, since g’(x) = nx"~!, we have 


_ ih _ i! 
i g'(x/”) av n(gi/n)n-1 = 


Now for a general rational number 7, there is an integer p and a positive 
integer qg such that r = p/q. It follows that 


f(x) = (a)! = (goh)(a), 


where 
g(a) = ar!" 
By Proposition 3.6, h’(x) = px?~'. We have just shown that g'(r) = 


<gan), By chain rule, 
q 


1 : 
g'(h(x))a'(x) = (arya x par} = ot = rat), 
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Exercises 3.2 


Question 1 
Given that the function f : (0,co) — R is defined by 


1 


ere 


(a) Show that f is one-to-one. 
(b) Show that f is differentiable. 
(c) Show that f~! exists and is differentiable. 


(d) Find f~1(x) and (f~')’(z). 


Question 2 


Let a be a positive number. Recall that a function f : (—a,a) — R is even 
if and only if 


for all x € (—a, a); 


and a function f : (—a, a) — R is odd if and only if 


f(-x) =—f(z) for all x € (—a, a). 


Let f : (—a,a) — R be a differentiable function. 
(a) If f is even, show that f’ is odd. 


(b) If f is odd, show that f’ is even. 
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3.3. The Mean Value Theorem and Local Extrema 


The mean value theorem is one of the most important theorems in analysis. We 
will first prove a special case of the mean value theorem called Rolle’s theorem. 
To prove this, we need the extreme value theorem, which asserts the existence 
of global maximum and global minimum for a continuous function defined on a 
closed and bounded interval. As a matter of fact, what we actually need is a local 
extremum, which we define as follows. 


Definition 3.6 Local Maximum and Local Minimum 


Let D be a subset of real numbers that contains the point xo, and let f : 
D — R bea function defined on D. 


1. The point x is a local maximizer of f provided that there is ad > 0 
such that for all x in D with |x — xo| < 6, we have 


ICE) SS 1Aea0)) 
The value f(x) is then a local maximum value of f. 


. The point x is a local minimizer of f provided that there is ad > 0 such 


that for all x in D with |x — xo| < 6, we have 


f(x) 2 f(@o). 
The value f (xo) is then a local minimum value of f. 


. The point x is a local extremizer if it is a local maximizer or a local 
minimizer. The value f(xo) is a local extreme value if it is a local 


maximum value or a local minimum value. 


The definition of local extremum that we give here is quite general. We do 
not impose conditions on the set D, nor require Zo to be an interior point of D. 
Other mathematicians might define it differently. Under our definition, a global 
extremum of a function is also a local extremum of the function. 

Derivative is an useful tool in the search for local extrema. When a local 


extremizer of a function is an interior point of the domain, and f is differentiable 
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A 


Figure 3.6: The function y = f(a) has local maxima at the points B and D, and 
local minima at the points A and C’. The point A is also where global minimum 
appears; while the point B is where the global maximum appears. 


at that point, the derivative of the function can only be zero at that point. 


Theorem 3.10 


Let (a,b) be a neighbourhood of the point zo, and let f : (a,b) > R 
be a function defined on (a,b). If xo is a local extremizer of f, and f is 
differentiable at xo, then f’(xq) = 0. 


Without loss of generality, assume that xo is a local maximizer. Then there 
isad > Osuch that (xp —6, 9 +0) C (a,b), and for all x in (x — 6, 9 +4), 
f(x) < f(xo). Since f is differentiable at xo, the limit 


jam £02) = £0) 


LLOQ £— Xo 


exists and is equal to f’(x 9). This implies that the left limit and the right 
limit both exist and both equal to f’(xo). Namely, 


fx) = F(t) _ 4, F@)= Fle) 


f'(@o) = lim 


LX tL — Xo 
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For the left limit, when z is in (%p—4, 29), ©—X%p < Oand f(x)—f (xo) < 0 


Therefore, 


f(@) — F(@o) 


20 when x € (2% — 6, 20). 
«tL — Xo 


Taking the x — x limit, we find that f’(a9) > 0. For the right limit, when 
x is in (%o,%p + 6), L— Xo > 0 but f(x) — f(xo) < 0. Therefore, 


f(&) — Fo) 


<0 when x € (1%, 20 + 6). 
«&— Xo 


Taking the x — xj limit, we find that f’(z9) < 0. Since the left limit shows 
that f’(29) > 0 while the right limit shows that f’(x,)) < 0, we conclude 
that 7 (29) = 0. 


This theorem gives a necessary condition for a function f : (a,b) > R to 


have a local extremum at a point where it is differentiable. Notice that it cannot 
be applied if the local extremizer is not an interior point of the domain. 


Definition 3.7 Stationary Points 


Let D be a subset of real numbers and let f : D — R be a function defined 


on D. If xo is an interior point of D, f is differentiable at x) and f’(x9) = 0, 


we call xo a stationary point of the function f. 


Hence, Theorem 3.10 says that if x is an interior point of D, and the function 


f : D — R 1s differentiable at x79, a necessary condition for xp to be a local 


extremum of the function f is xp must be a stationary point. Nevertheless, this 
condition is not sufficient. For example, the function f(x) = ° has a stationary 
point at z = 0, but x = 0 is not a local extremizer of the funnction. 

Now let us return to the mean value theorem. As a motivation, let us consider 
the distance s travelled by an object as a function of time t. We have discussed in 
Section 3.1 that to find the instantaneous speed of the object at a particular time 
to, we first find the average speed over the time interval from tg to to + At, and 
take the limit At — 0. Namely, the instantaneous speed at time fo is 

s(ty + At) — s(t 
pe teen 
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which is precisely s’(tp), the derivative of s(t) at t = to. The mean value theorem 
asserts that the average speed of the object in a time interval |t,,t2] must equal 
to the instantaneous speed s’(to) for some to in that interval. Intuitively, this is 
something one would expect to be true. 

Now let us prove a special case of the mean value theorem. 


Theorem 3.11 Rolle’s Theorem 


Let f : [a,b] > R be a function that satisfies the following conditions. 


(i) f : [a,b] + R is continuous. 


(ii) f : (a,b) > R is differentiable. 


(iii) f(a) = f(). 


Then there is a point x in (a, b) such that f’(x9) = 0. 


Since f : [a,b] — R is a continuous function defined on a closed 
and bounded interval, the extreme value theorem says that it must have 
minimum value and maximum value. In other words, there are two points 
x1 and £2 in [a, b] such that 


Hf CEES EOS Co) for all x € [a, }]. 


Notice that x, and x2 are also local extremizers of the function f : [a,b] > 
R. If f(x1) = f (x2), then f is a constant function. In this case, f(x) = 0 
for all x in (a,b). If f(a) # f(x), then f(x) < f(x2). Since f(a) = 
f(b), either x; or x2 must be in the open interval (a,b). In other words, 


there is a local extremizer xo in the interval (a,b). Since f is differentiable 
at x9, Theorem 3.10 says that we must have f’(z9) = 0. In either case, 
there is an 29 in (a, b) satisfying f’(xo) = 0. 


Now we can prove the mean value theorem. 
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Figure 3.7: The Rolle’s theorem. 


Theorem 3.12 Mean Value Theorem 


Let f : [a,b] > R be a function that satisfies the following conditions. 


(i) f : [a,b] + R is continuous. 


(ii) f : (a,b) > R is differentiable. 


Then there is a point xp in (a, b) such that 


f(6) — f(a) 
cn 


f'(o) = 


The mean value theorem stated in Theorem 3.12 is also referred to as Lagrange’s 
mean value theorem. Notice that Rolle’s theorem is a special case of the mean 
value theorem where f(a) = f(b). The quantity 


f(0) — F(a) 
b-—a 
gives the average rate of change of the function f(a) over the interval |a, b], 
and the mean value theorem says that this average rate of change is equal to 
the rate of change at a particular point. To prove the mean value theorem, we 
apply a transformation to the function f(x) to get a function g(x) that satisfies the 
conditions in the Rolle’s theorem. 
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Let g : [a,b] > R be the function defined by 


+ ta 
Notice that the function g : [a,b] + R is continuous, and g : (a,b) > 
differentiable with 


(0) — fla) 
f(a) = fe) —m= fi@)- “9 
—a 
By construction, g(a) = g(b). Hence, we can apply Rolle’s theorem to the 
function g and conclude that there is a point 29 in (a, b) such that g’(ao) = 


0. For this point xo, 


f(b) — fla) 
b-aq 


f'(&o) = 


This proves the mean value theorem. 


Figure 3.8: The mean value theorem. 


Notice that for the mean value theorem to hold, the function f : [a,b] + Rdo 
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not need to be differentiable at the end points of the interval [a,b], and the point 
Xo is guaranteed to be a point in the interior of the interval. 

The mean value theorem has very wide applications. We will discuss a few in 
this section. 

Recall that the derivative of a constant function is 0. The converse is not 


obvious, but it is an easy consequence of the mean value theorem. 


Lemma 3.13 


If the function f : [a,b] + Ris continuous on {a, b], differentiable on (a, b), 
and f’(x) = 0 for all x € (a,b), then f is a constant function. 


Take any x € (a,b]. Then f is continuous on [a, x], differentiable an (a, 2). 


Therefore, we can apply mean value theorem to conclude that there is a 
point c in (a,x) such that 


f(@) = fl@) 


so — (6) 


=f (oe) =0: 


This proves that f(a) = f(a). Therefore, the function f is a constant. 


From this, we immediately obtain the following. 


Theorem 3.14 


Assume that the functions f : [a,b] > Rand g: [a,b] > R are continuous 
on [a,b], differentiable on (a, b), and 


for all x € (a, )). 


Then there is a constant C’ such that 


f(z) = g(x) +C for all x € [a, }). 
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Define the function h : [a, b] + R by 


f(x) — g(2). 


Then the function h is continuous on [a,b], differentiable on (a,b), and 
h'(x) = 0 for all x € (a,b). By Lemma 3.13, hf is a cosntant function. 


Namely, there is a constant C’ so that h(x) = C for all x € |a, |. Therefore, 


f(z) = g(x) +C for all x € [a, bj. 


Theorem 3.14 implies the identity criterion, which says that if two functions 
are differentiable in an open interval, their derivatives are the same, and 
their values at a single point in the interval coincide, then these two 
functions must be identical. 


We have seen that if p(x) is a polynomial of degree n, and k is an integer larger 
than n, then the k"*-order derivative of p(x) is identically zero. Using Lemma 3.13, 
we can prove that the converse is also true. 


Example 3.12 


Let n be a nonnegative integer. Assume that the function p : R — R is 


(n + 1) times differentiable and p+? (x) = 0 for all real numbers 2. Then 
p(x) is a polynomial of degree at most n. 


We prove this by induction on n. When n = 0, the statement says that 
if p : R — Ris a differentiable function and p'(x) = 0 for all x € R, 


then p(x) is a polynomial of degree 0. Since a polynomial of degree 0 is a 
constant, this statement is true by Lemma 3.13. 

Now let n > 1, and assume that we have proved that for any k < n, if 
q: R > Risa function that is (k+1) times differentiable and gt) (x) = 0 


for all real numbers z, then g(a) is a polynomial of degree at most k. 
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Let p : R > R be a function that is (n + 1) times differentiable and 
p*) (x) = 0 for all real numbers x. Lemma 3.13 says that there is a 
constant C’ such that 

p(x) =C. 


Consider the function q : | R defined by 


C on 
p(z) — ale: 


It is n times differentiable and 


q”)( )= p\”)(a) —-C=0 for all x € R. 


By inductive hypothesis, q(x) is a polynomial of degree at most n — 1. 
Namely, there are constants do, @1, ..., @,— 1 Such that 


NC) Dye ae oe tina ae te 
This implies that 
p(x) = Ane” + Gp z™ | +---+a,¢ + a9, 


where a,, = C'/n!. Hence, p(x) is a polynomial of degree at most n. 


Mean value theorem can be used to estimate the magnitude of a function 
provided that we know the derivative. 


Example 3.13 


Given that the function f : [0,10] —> R is continuous on {0,10}, 


differentiable on (0,10), and —3 < f’(x) < 8 for all x in (0,10). If 
= —2, find a range for the values of f(z). 
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Solution 
Let x be point in (0, 10]. By mean value theorem, there is ac € (0,2) such 
that 


= 6) 


@ = 
Since —3 < f’(c) < 8, we find that 


—3xr < f(x) +2 < Bz. 
This implies that 
—32 < —34 —2 < f(x) < 84-2 < 78. 


Therefore, a range for the values of f(a) is (—32, 78). 


The next example shows that the mean value theorem can be used to determine 
the number of solutions of an equation. 


Example 3.14 
Recall that in Example 2.27, we have shown that the equation 
a°+6r+1=0 
has a real root. Determine the exact number of real roots of this equation. 
Solution 


Let f : R > R be the function f(x) = 2° + 6x +1. This is a differentiable 
function with 


f'(z) = 6x? +6. 


From this, we find that f’(x) = 0 if only if x° = —1, if and only if z = —1. 
If x, and x2 are two points such that 7; < x and f(x,) = f(x2) = 0, 
Rolle’s theorem says that there is a point u in (x1, x2) such that f’(w) = 0. 
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If f(x) = 0 has three distinct real roots, we can assume that these real roots 


are £1, £2 and x3 with x; < xq < x3. Then there is a wu; in (1,22), and 
a Ug in (#2,x3) such that f’(ui) = f’(w2) = 0. In other words, f’(x) = 0 
has two distinct real roots wu, and w2. But we have shown that there is only 
one x such that f’(x) = 0. Therefore, f(x) = 0 can have at most two real 
solutions. 

Since f(0) = 1, we have f(—1) < 0 < f(1). By intermediate value 
theorem, there is a c; € (—1,0) such that f(c,) = 0. 

Since f(—2) = 53, we have f(—1) < 0 < f(—2). By intermediate value 
theorem, there is a cp € (—2, —1) such that f(c2) = 0. 

We conclude that f (2) = 0 has exactly two real roots. 


Another important application of the mean value theorem is to determine the 


increasing or decreasing patterns of functions. 


Theorem 3.15 


Given that f : [a,b] — R is a function continuous on [a,b], and 
differentiable on (a, b). 


1. If f'(~) > 0 for all x € (a,b), then f : [a,b] + Risa strictly increasing 
function. 


2. If f’(x) < 0 for all x € (a,b), then f : [a,b] + Risa strictly decreasing 
function. 


Notice that we only assume that f’ is positive or negative on the open interval 
(a, b). If f’ exists at the end points, it can be 0 there, and the conclusion about the 
strict monotonicity still holds for the entire closed interval [a, b). 


It suffices for us to prove the first statement. Given any two points x; and 
x2 in the closed interval [a, b] with 7 < x2, the function f is continuous on 


[71,2], differentiable on (x1, x2), and f’(x) > 0 for any x € (21,22). By 


mean value theorem, there is a point c in (21, x2) such that 
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f(@2) = f(@) 


TQ — Ly 


=e) 


Since f’(c) > 0 and x2 — x; > 0, we conclude that 


f (x2) > f(x). 


This proves that f : [a, b] — R is strictly increasing. 


We look at a simple example. 


Example 3.15 


Consider the function f : R > R, f(x) = x°. Notice that f is differentiable 
and f’(x) = 3x. Hence, f’(x) > 0 for x # 0, but f’(0) = 0. Therefore, we 
cannot apply Theorem 3.15 directly to conclude that f : R > R, f(x) = x? 


is a Strictly increasing function. However, we can proceed in the following 


way. Since f’(x) > 0 on the open interval (—oo, 0), Theorem 3.15 implies 


that f is strictly increasing on the closed interval (—oo, 0]. Since f’(x) > 0 


on the open interval (0, co), Theorem 3.15 again implies that f is strictly 


increasing on the closed interval [0, 00). Combining together, we conclude 


that f : 


R—-> 


R, f(x) = x? is strictly increasing. 


Remark 3.2 


Let f : [a,b] — R be a function defined on [a,b], and let 21,..., 2, be 


points in (a, b) such that the following conditions are satisfied. 


(i) f is continuous on {a, b], differentiable on (a, 6). 


GO f(a) — 0 for] b= 


(iii) f’(x) > O for any x € (a, b) \ {41,..., an}. 


Using the same reasoning as in Example 3.15, one can prove that f is 


strictly increasing on [a, b]. 


Example 3.15 shows that if a function f : (a,b) — R is differentiable and 


strictly increasing, it is not necessary that f’(x) > 0 for all x € (a,b). If we 
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relax the strict monotonicity to monotonicity, we will find that f’(a) > 0 for all 
x € (a,b) is sufficient and necessary for f to be increasing. 


Theorem 3.16 


Given that the function f : [a,b] — R is continuous on |a,b], and 
differentiable on (a, b). 


1. f : [a,b] > R is an increasing function if and only if f’(~) > 0 for all 
x € (a,b). 


2. f : [a,b] > R is a decreasing function if and only if f’(x) < 0 for all 


x € (a,b). 


Again, let us consider the first statement. If f’(2) > 0 for all x € (a,b), 
the proof that f is increasing is almost verbatim the proof in Theorem 3.15, 
with > replaced by >. For the converse, if f is increasing on |a, b], we want 
to show that f’(z9) > 0 for any zp in (a, b). This follows from the fact that 


f(x) — Fo) 


XL — XO 


> 0 


for any x in (a, b)\ {0} since f is increasing. Taking limit gives f’(2o) > 0 


For a function f() that is differentiable, the condition f’(% 9) = 0 is necessary 
for an interior point x9 to be a local extremizer, but not sufficient. Theorem 3.15 
provides the tool for determining whether such point is a local extremizer. It is 
called the first derivative test. We would not go into the general formulation. 
Instead, we will apply Theorem 3.15 or Theorem 3.16 directly to solve such 
problems. 
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Example 3.16 


Consider the function f : R defined by 


x 


He) seer 


Find the local maximum value and the local minimum value of f, and find 
the range of the function f. 


Solution 
Since f is a rational function, it is differentiable, and 


f'(e) = (x? + 1) — x(2z) _! =5e 7 (2 +1)(x—1) 
(a? + 1)? (a? + 1)? (a? +1)? 


Since f is differentiable everywhere, the only candidates for the local 
maximizer and the local minimizer are those points x where f’(x) = 0, 


which are the poins x = —1 andz = 1. 

e When x € (—oo,—1), f’(x) < 0, and so f is decreasing on (—oo, 1]. 
e When x € (—1,1), f’(x) > 0, and so f is increasing on [—1, 1]. 

e When z € (1,00), f’(x) < 0, and so f is decreasing on [1, 00). 


These imply that x = —1 is a local minimizer, and x = 1 is a local 
maximizer. The local maximum value of f is f(1) = 5, and the local 
minimum value is f(—1) = —4. Notice that 


his ee) = Nhe eh 


=L— —Co XL CO 


Since f is decreasing on (—oo, —1], for any x in (—oo, —1], 
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Since f is decreasing on [1, co), for any z in [1, 00), 


1 


USS) SC) ass 


1 5]. 


Combining together, we conclude that the range of f is [—5, 5 


Figure 3.9: The function f(z) = 


vet. 


There is also a second derivative test for determining whether a stationary 


point is a local minimizer or a local maximizer. 


Theorem 3.17 Second Derivative Test 


Let (a, b) be an interval that contains the point xo, and let f : (a,b) > 


be a differentiable function. Assume that f’(x ) = 0, and f” (a9) exists. 
1. If f’(xo) > 0, then xp is a local minimizer of f. 


2. If f” (ao) < 0, then xo is a local maximizer of f. 


The second derivative test is inconclusive if f(a 9) = 0, as can be shown by 
considering the three functions f\(x) = x4, fo(x) = —a* and f3(x) = 2°. 
All these three functions have x = 0 as a stationary point. Their second 


derivatives are all equal to zero at x = 0. However, x = 0 is a local 


minimizer of f;(2) = 2’, it is a local maximizer of the function f2(x) = 


—x*, and it is not a local extremizer for the function f3(7) = 2°. 
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Proof of Theorem 3.17 
We will give a proof of the first statement. The proof of the second 
statement is similar. For the first statement, we are given that f’(%9) = 0 
and f” (a9) > 0. By definition, 
¢ (2) — lim (x) = Fao) = Feo) = in pay 
LO ae = eG L—>x0 LG — Lo 


Take € to be the positive number f”(xo)/2. The definition of limit implies 
that there is ad > 0 such that (1% — 6,79 +6) C (a,b), and for all the points 
£ in (%o — 6, £9) U (Zo, £0 + 9), 

f'(@) 


Ib — Jb) 


f" (Xo) 
9 . 


= Peo) < 


This implies that for all 7 € (ao — 6,20) U (0, %o + 0), 


P(@) Sen f' (to) _ f"(@o) 
meee i ee ane ae (3.3) 


If x € (ap — 6,29), Z — Lo < O. Equation (3.3) implies that f’(x) < 0. 
Therefore, f is decreasing on (29 — 6, Z|. This implies that 


(er aG) for all x € (9 — 6, 20). 


If x € (x9,% + 6), Y — Zp > OV. Equation (3.3) implies that f’(x) > 0. 
Therefore, f is increasing on 19, 7) + 6). This implies that 


a 2 eae for all x € (x, %p + 0). 


Combining together, we find that f(x) > f(xo) for all x in (ap — 6, 79 +0). 
This proves that xo is a local minimizer of /. 
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Example 3.17 


For the function f(x) considered in Example 3.16, we have shown that the 
stationary points are x = —1 and x = 1. A tedious computation gives 


_ 22(z? — 3) 


f"(@) = 


Hence, 


The second derivative test can then be used to conclude that x = —lisa 


local minimizer, and x = 1 is a local maximizer. 


Although applying the second derivative test seems straightforward, an analysis 
using the first derivative test is more conclusive. Finding the second derivative can 
also be tedious, as shown in the example above. 

At the end of this section, we want to prove an analogue of intermediate value 
theorem for derivatives. 


Theorem 3.18 Darboux’s Theorem 


Let f : [a,b] > R be a differentiable function. If w is a value strictly 
between /f’ (a) and f’ (b), then there is a point c in (a, b) such that f’(c) = 


W. 


If the function g’ is continuous, then Darboux’s theorem follows immediately 
from the intermediate value theorem. The strength of Darboux’s theorem lies in 
the fact that it does not assume the continuity of g’. 


The proof is an again an application of the extreme value theorem. 
Without loss of generality, assume that f(a) < w < f(b). Since f : 


[a, b] + R is a differentiable function, it is continuous. Define the function 
g: [a,b] > R by 
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Then g is differentiable and 


Notice that g : [a,b] — R is also continuous. By extreme value theorem, 


g: [a,b] + Rhas a minimum value. Now, 


g(a) = fi(a)—w <0, 


By definition, 


Taking ¢€ to be the positive number —g’, (a) /2, we find that there is a d > 0 
such that 6 < b — a, and for all x € (a,a +4), 


g(a) — g(a) 


/ 
< g(a) +e= 94.(a) =o0: 


10} 2 
In particular, for all x € (a,a +), g(x) < g(a), and thus g(a) is not 
a minimum value of the function g. Similarly, since g' (b) > 0, we find 
that g(b) is not a minimum value of the function g. In other words, the 
minimizer of g must be a point c inside (a,b). This is then also a local 
minimizer. Since g is differentiable, we must have g'(c) = 0. This implies 
that {/(c)— we: 


Remark 3.3 


As a consequence of the Darboux’s theorem, we find that if a function f : 
(a,b) — R is differentiable and f’(x) ¢ 0 for any x € (a,b), then either 
f'(x) > 0 for all x € (a,b), or f’(x) < 0 for all x € (a, b). In any case, this 
means that such a function must be strictly monotonic. 


Before closing this section, let us define a terminology. 
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Definition 3.8 C* functions 


Let & be a nonnegative integer. We say that a function f : (a,b) — R 


is a C*-function it is has k times derivatives and the k'-derivative f : 


(a, b) + Ris also continuous. 


It s easy to see that if f : (a,b) + Ris a C*-function, then for any 0 < j < k, 
f® : (a,b) + R is continuous. 


A C® function is just a continuous function. A C' function is called a continuously 
differentiable function. In general, a C* function is called a k-times continuously 
differentiable function. 

The definition of C* functions can be extended to the case where the function 
f is defined on a closed interval [a, }}. 
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Exercises 3.3 


Question 1 


Given that the function f : [—5,8] — R is continuous on [—5,8], 
differentiable on (—5,8), and —4 < f’(x) < 4 for all x in (—5,8). If 
f (0) = 2, find a range for the values of f(z). 


Question 2 


Show that the function f : R > R, 


7 


ge+i1 


he 


is strictly increasing, and find the range of the function. 


Question 3 


Show that the equation 
xr +x+32=0 


has exactly one real solution. 


Question 4 
Find the number of real solutions of the equation 
3250 
z4+16 


Question 5 


Let n be a nonnegative integer, and let f : (a,b) — R be a differentiable 
function. If the equation f’(a) = 0 has n distinct real roots in the interval 
(a, b), show that the equation f(a) = 0 has at most (n + 1) distinct real 
roots in the interval (a, b). 
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Question 6 


Consider the function f : R — R defined by 


at+l1 
1) = maar 


(a) Find the local maximum value and the local minimum value of f. 


(b) Find the range of the function /. 


Question 7 
Let f : [a,b] > R bea function such that the limit 
be im SOF 
a—b- 36. b 
exists. If L > 0, show that there is a 6 > O such that 6 < b — a and for all 
x € (b—4,5), 
Ga <i) 


Question 8 


Let f : (a,b) > R be a differentiable function. Suppose that f’ : (a,b) > 
IR is monotonic, show that f’ : (a,b) > R is continuous. 


Chapter 3. Differentiating Functions of a Single Variable 193 


3.4 The Cauchy Mean Value Theorem 


In previous section, we have seen that the mean value theorem is very useful in 
analysing the behavior of a differentiable function. For future applications, we 
will often quote it in the following form. 


Alternative Form of Mean Value Theorem 


If f : (a,b) > Ris a differentiable function, xo is a point in (a,b), h is 
such that xo + h is also in (a, b), then there is a number c € (0, 1) such that 


f(xo +h) — f(x0) = f' (xo + ch)h. (3.4) 


To see this, let x; = 2g +h. If h = 0, (3.4) is obviously true for any c in (0, 1). 
If h ¥ 0, then when c runs through all values from 0 to 1, x) + ch runs through 
all points in the open interval J with xo and x, as endpoints. Thus, (3.4) says that 


f (ei) — f(o) = f'(u)(a1 — 0) 


for some u in the open intefval J, which is precisely the statement of the mean 
value theorem. 
When finding limits of functions, we often encounter situations like 
f(x) 


ia 
ri g(a) 


where both lim f(x) and lim g(x) are zero. For example, let 
L>XO L>XO 
f(a) =a" + 22° =3 and g(x) = 27-1. 


Then 
in fe) = 71) =0 and limig( 2) = 9(1) = 0. 


x1 x1 


Hence, we cannot apply limit quotient law to evaluate 


f(a) i x9 + 22° — 3 
im ——.—___.. 
zl g(x) tl gi — 1 


Observe that 
fate) 
z+1 g(x) h>0 g(1 +h)’ 
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Since we are only interested in the limit when x approaches 1, we are prone to use 
the mean value theorem in the form (3.4) and conclude that there are c,; and co in 
(0, 1) such that 


i ad Oe) 


ml g(x) h0 g(L+h)—g(1) — h0 g/(1 + exh)’ 


(3.5) 


For the functions f and g that we consider above, f’ and g’ are both continuous at 
x = 1and g’(1) 4 0. Hence, we find that 


fl+ah) _ fF) 


nv0 gi(l-+egh)  g/(1) 
For general differentiable functions f(a) and g(a) with f(1) = g(1) = 0, if we 
do not assume that f’ and g’ are continuous, we cannot conclude the limit from 
(3.5) since c, and cp are in general different functions of h. 
In this section, we are going to prove a generalization of the mean value 
theorem, called the Cauchy mean value theorem, which ensures that we can have 
the same value for c; and cy». 


Theorem 3.19 Cauchy Mean Value Theorem 


Let f : [a,b] + Rand g : [a,b] > R be two functions that satisfy the 
following conditions. 


(i) f : [a,b] > Rand g: [a, b| > R are continuous. 


(ii) f : (a,b) > Rand g: (a,b) > R are differentiable. 


(iti) g'(x) £0 for all x € (a,b). 
Then there is a point xo in (a, b) such that 


f'(@o) _ f(b) — F(a) 


(xo) —_9(b) — g(a)’ 


Notice that when g(x) = x, we have the Lagrange’s mean value theorem. 
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The proof uses the same idea as the proof of Lagrange’s mean value 
theorem, with the function g(x) = «x replaced by a general g(x). By 
Remark 3.3, the condition g/(x) # 0 for all x € (a,b) implies that g is 
strictly monotonic. Hence, g(a) # g(b). 

Define the function h : [a,b] + R by 


where the number m is determined by h(a) = h(b). This means 


f(a) — mg(a) = f(b) — mg), 


which gives 
_ £0) = fla) 
~ Sue 


Again, the function h : [a,b] > R is continuous on [a, bj, differentiable on 


(a,b), and satisfies h(a) = h(b). By Rolle’s theorem, there is a point x9 in 
(a, b) such that h’(29) = 0. For this xo, 


f'(£o) = mg’ (ao) =. 


Since g'(x9) # 0 by assumption, we find that 


f'(xo) 
b-a 


Example 3.18 


Consider the functions f : [1,7] > R, f(x) = 2? andg: [1,7] > R, 
g(x) = x — 9x*. By Lagrange’s mean value theorem, there are points c, 
and cp in (1,7) such that 


Ye = f'(cr) = f(7) a 


de, — 185 = g (@)) = 
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Solving for c; and c2, we have c; = 4 and and c2 = 5. 


By Cauchy mean value theorem, there is a point c in (1,7) such that 


2c (LOO) 


3c2 — 18c g'(c) * g(7) — g(1) 15), 


Solving this equation gives 


An important application of the Cauchy mean value theorem is the following. 


Theorem 3.20 


Let n be a positive integer, and let (a,b) be an open interval that contains 


the point xo. If the function f : (a,b) + Ris n times differentiable, and 


et) tC ee ars) 


then for any x in (a, b), there is ac € (0,1) such that 


n 


h 
f(a) = — fF (eo + ch), where h = x — Xo. (3.6) 


We apply the Cauchy mean value theorem n times to the given function 
f : (a,b) + Rand the function g : (a,b) + R defined by g(x) = (x—2)”. 
Notice that g is also n times differentiable, 


Gt) — 9 Gp) — G(r) 0) 


and 
g(x) =n! for all x € (a,b). 


Since f (xo) = 0, eq. (3.6) obviously holds for x = xo with any c € (0,1). 

So we only need to consider a point x = 2, in (a,b) \ {xo}. First assume 

that 7, > 2. For any 1 < k < n, g(x) # 0 for any x € (x, 71). Thus 

we can apply the Cauchy mean value theorem for the pairs (f,g), (f’, 9’), 
» (f°, g@-Y) over the interval (xo, 71). 
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Since f (x9) = g(ao) = 0, Cauchy mean value theorem implies that there 


exists a point wu, in (2%, 21) such that 


F(x) = (Ga) Gy) = F(t) 


Ge slew Gao) eg a) 


If n = 1, we are done. If n > 2, then f’(29) = g'(xo) = 0. Apply Cauchy 
mean value theorem again, we find that there is a wz in (29, u;) such that 


Cio) yet (i) et (a) 


gla1) g(t) g(t) — g(a) 


Continue with this n times, we find that there are points w,,...,u,, such 
that %p < Un < Un_y << Uy < X, and 


2 7) (un) 
gin) 


(3.7) 


Since un € (Xo, 21), there is c € (0,1) such that u, = x + ch, where 
h = x1 — £o. Eq. (3.7) then implies that 


h” 
i — f(x + ch), where h = x1 — Xp. 


This completes the proof if x, > Xo. The proof for x; < Zo is similar. 


Let us look at a classical example. 


Example 3.19 


Let xo be a point in the interval (a,b), and assume that the function f : 


(a, b) + R is twice continuously differentiable. Prove that 


ee F(%o +h) + f(zo — bh) — 2f (Zo) 
a) fe 


—_ i (xq): 
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Solution 
Let r = min{zo — a,b — xo}. Then r > 0 and (ap — r,20 +r) C (a, 0). 
Define the function g : (—r,r) > R by 


g(h) = f(zo +h) + f(zo — h) — 2f (zo). 
Then g is twice continuously diferentiable, and 
g'(h) = f'(@o + h) — f'(xo — A), g'(h) = f" (ao +h) + f" (x0 — A). 


It is easy to check that 
gO — 9 (0) —0: 
By Theorem 3.20, for any h € (—r,1r), there is a c(h) € (0, 1) such that 


g(h) = <a" (e(h)h). 


Hence, 
g(h) _ f"(wo + elhyh) + f"(wo = (h)h) 


he 2 
Now since c(h) € (0,1), 


|c(h)h| < |. 


Therefore, 
lime hi — 0: 


h->0 


Since f” is continuous, 


lim f" (ao + k) = f" (a0). 


By limit law for composite functions, we find that 


fam Leto t+ e(h)h) + F"(awo—e(h)h) _ f"(a0) + f"(wo) _ 
h0 2 D 


Therefore, 


km [Gear (ae ean — 1) 2a aa Re 


a0 ne h>0 h? 
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Exercises 3.4 


Question 1 


Given that p(a) is a polynomial of degree at most 5, and 


pl) = pM) = pP'() = pPPd) =pEa)=0, p®™a)=1200. 


Find the polynomial p(x). 


Question 2 


Let (a, b) be an interval that contains the point xo. Given that the function 
f : (a,b) > R is three times continuously differentiable, find the limit 


h-0 hs 
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3.5 Transcendental Functions 


Up to now we have only dealt with algebraic functions, which are functions that 
can be obtained by performing algebraic operations of addition, multiplication, 
division and taking roots on polynomials. In this section, we introduce other 
useful elementary functions — the class of transcendental functions which includes 
exponential, logarithmic and trigonometric functions. These functions have been 
introduced in a pre-calculus course, but not rigorously. 

In this section, we are going to define these functions and derive their properties 
using calculus. Everything would be done rigorously using the analytic tools that 
we have developed so far, except for an existence theorem that we are going to 
prove in Chapter 4. 


Let us first state this existence theorem. 


Theorem 3.21 Existence and Uniqueness Theorem 


Let (a, b) be an open interval that contains the point zo, and let yo be any 


real number. Given that f : (a,b) — R is a continuous function, there 


exists a unique differentiable function F’ : (a,b) — R such that 


f(x) for all x € (a,b), F(x) = yo: 


The function F(x) that satisfies F’(a) = f(a) is called an antiderative of 
f(a). 


Definition 3.9 Antiderative 


Let J be an interval. If f : J + Rand Ff’: J — R are functions on J such 
that F' is differentiable and 


for all x € J, 


then F(x) is called an antiderivative of f(x). 


Theorem 3.21 asserts that a continuous function has an antiderivative. One 
way to construct an antiderivative is to use integrals, a topic we are going to 
discuss in Chapter 4. Theorem 3.14 says that any two antiderivatives of a given 


function differ by a constant. The initial condition F'(xo) = yo fixes the constant. 
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Hence, only the existence part of Theorem 3.21 is pending a proof. The uniqueness 
follows from what we have discussed. 


3.5.1. The Logarithmic Function 


It is easy to check that for any integer n that is not equal to —1, an antiderivative 
of the function f(x) = x” is the function 


n+l 


nt+1 
So far we haven’t seen any algebraic function whose antiderivative is equal to 


1 
f(x) = —. We define one such function and call it the natural logarithm function. 
x 


The natural logarithm function f : (0,00) > 


be the unique differentiable function satisfying 


; Lg 
Since g : (0,00) > R, g(x) = — is a continuous function, the existence and 


x 
uniqueness of the function f(x) = In x is guaranteed by Theorem 3.21. 


The Natural Logarithm Function 


By definition, 
d 


l : >0 
—Ing=-— x : 
dx : oe 


Since 1/x > 0 for all x > 0, we find that f(2) = In x is a strictly increasing 


function. Moreover, since In 1 = 0, 


e when0d<2<1,Inz <0; 


e whenz>1l1,lnz>0. 


The following gives some useful properties of the natural logarithmic function. 
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Figure 3.10: The function y = Inz. 


Proposition 3.22 Properties of the Natural Logarithm Function 


Let x and y be any positive numbers, and let 7 be a rational number. We 


have the following. 


(a) In(vy) =Inz+Iny 


(b) In =Inz—Iny 


(cycling — 7 ine 


In part (c), we require 7 to be a rational number since we have not defined x” 


when r is an irrational number. 


To prove (a), we fixed y > 0 and define the function f : (0,00) >| 


f(x) =In(ay) — ny. 


Then f(1) = Iny — Iny = 0, and 


Ge ee 


By the uniquesness asserted in Theorem 3.21 and the definition of the 
natural logarithm function, we conclude that f(x) = Inz. This proves 


(a). 
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To prove (b), we notice that part (a) gives 


In @ +Iny = In (¢ x ) Sinise 
y y 


For (c), notice that it is obvious if r = 0. If r 4 0, define the function 
f : (0,co) > R by 


= In see 
Then f(1) = 0, and 


This allows us to conclude that f(2) = In 2, and (c) is thus proved. 


From part (b) of Proposition 3.22, we find that for any x > 0, 


1 
In— =Inz-1 = —Ing; 
z 
and if 7 is a positive integer, 


Inv” =nlInz. 


In particular, we find that 


In 2” = nIn 2, 
1 

In — = —nIn2. 

Don nin 


Since In 2 > 0, we conclude the following. 


Proposition 3.23 


R, f(z) = Inz is a strictly increasing function with 


lim Ing = =a, him In ge — cc. 
a—0t +00 


Hence, the range of f(x) = Inz is 
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3.5.2 The Exponential Functions 


Since the function f : (0,co) — R, f(x) = Inz is continuous and strictly 
increasing, its inverse function exists. We define this inverse function as the 


exponential function exp(x). The domain of exp(z) is the range of In x, which is 


R. The range of exp(x) is the domain of In x, which is (0, 00). 


Definition 3.11 The Natural Exponential Function 


The natural exponential function exp : R is defined to be the inverse 


of the function ln z. It satisfies 


Inexp(z) =a foranyze€R, exp(Inz) =a forany x > 0. 


Figure 3.11: The function y = exp(z). 


We can deduce the following properties. 


Proposition 3.24 Properties of the Natural Exponential Function I 


The exponential function exp(x) is a strictly increasing differentiable 
function defined on the set of real numbers. It has the following properties. 


(a) exp(xz) > 0 for all x € R and exp(0) = 1. 


(b) lim exp(x) =0, lim exp(z) = oo. 
fi 16,0) LOO 


d 
(c) J exp(x) = exp(2). 
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(a) and (b) are obvious from the corresponding properties of In x. For part 
(c), we employ the derivative formula for inverse function. To make it less 


confusing, let y = exp(x). Then 


nea. 


Differentiating both sides with respect to x, we find that 


Therefore, 


From the properties of the natural logarithm stated in Proposition 3.22, we 
have the following. 


Proposition 3.25 Properties of the Natural Exponential Function II 


Let x and y be any real numbers, and let r be a rational number. We have 
the following. 


(a) exp(x + y) = exp(z) exp(y). 
(b) exp(x — y) 


(c) exp(x)" = exp(rz). 


Let u = exp(x) and v = exp(y). Then u and v are positive numbers and 


oie, fine 
By Proposition 3.22, 


In(uv) =Inu+lnv=2+y. 
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Therefore, 


exp(x) exp(y) = uv = exp(z + y). 


Part (b) is proved in the same way. For part (c), Proposition 3.22 implies 
that 


hen | = hey = see, 


Therefore, 


exp exper 


Notice that part (c) says that for any postive number wu, and any rational number 


u” = exp(r Inu). 
We can use this to define power functions with irrational powers. 


Definition 3.12 Power Functions 


For any real number r, the power function f(x) = x” is the function defined 
on (0, 00) by the formula 


~ expr ing): 


When 7 > 0, we can extend the definition to the point x = 0 by definining 


f(0) =0. 


We have seen that this definition coincides with the old definition when r is 
a rational number. For r > 0, since nz — —oo asx > OT, rlnxz — —oo 
as z — Ot. Since exp(x) — 0 as x — —oo, we conclude that 7” — 0 as 
x —» 0+. Therefore, the definition f(0) = 0 makes the function f(x) = x” 
continuous. Using the fact that exp(a) and Inz are inverses of each other, we 
have the following. 


For any positive number x and any real number r, 


Ine Vea lin a 


Since both In x and exp(z) are strictly increasing functions, it is easy to deduce 
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aan 
ae 


(a) (b) 
Figure 3.12: (a) The function y = gv?, (b) The function y = gov? 


the following. 


Monotonicity of Power Functions 


1. When r > 0, the function f : [0,c0) - = x" is strictly 


increasing. 


2. When r < 0, the function f : (0,00) > x" is strictly 
decreasing. 


The following gives the properties of power functions. 


Proposition 3.26 


For any positive numbers x and y, and any real numbers r and s, 
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For part (a), we have 


(xy) = exp (r In(zy)) = exp(r nz +riny) 


= exp(rlnx) exp(rlny) = 2’y’. 
Part (b) is proved in the same way. For part (c), 
g’t* = exp((r +s) Inz) = exp(r Inz) exp(sInz) = 2" 2". 


Part (d) is proved in the same way. For part (e), 


(Ce rex Gln) exp (ns Ine 


Using chain rule, we find that f(x) = x” is a differentiable function. 


Proposition 3.27 


For any real number r and any positive number z, 


This follows from straightforward computation. 


oe _ (lin De nets =2"x =rex 
dx dx dx 10 


r—-1 


Now we want to show that exp(1) = e, where e is the number we defined as 


1 n 
e= lim (1 + = | 
n—0o n 


in Chapter 1. 
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Theorem 3.28 


This imples that 


We consider the differentiable function g(x) = In(1 + x), « > —1, whose 
derivative is 


Since exp() is a continuous function, we find that 


In(1 In(1 
x20 403 x20 ae 


Notice that {1/n} is a sequence of positive numbers that converges to 0. 


Therefore, eq. (3.8) implies that 


) 
lim exp (x In (1 + =) = exp(1). 
nN Cco nN 


By definition, 


Thus, we have shown that 


1 n 
exp(1) = lim (1 + - | =. 


Noo 


Since exp(z) and In x are inverses of each other, we find that Ine = 1. 
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Definition 3.13 General Exponential Functions 


Let a be a positive real number such that a 4 1. The exponential function 
f(x) = a* is defined by 


a’ = exp wing), xceER. 


When a = e, f(x) = e® is the natural exponential function 


€) — exp 0) 


Henceforth, we will also use e* to denote the natural exponential function 


exp(z). 
The following properties of the general exponential functions can be easily 


derived from the corresponding properties of the exp(x) function. 
Proposition 3.29 
Let a be a positive number. 
1. When 0 <a <1, f(x) =a’ isa strictly decreasing function. 


2. When a > 1, f(x) = a” is a strictly increasing function. 


Proposition 3.30 


Let a be a positive number such that a # 1. The function f(z) = a” is 
differentiable, and 
a =a Ing. 


dx 


Proposition 3.31 


Let a be a positive number such that a 4 1. For any real numbers x and y, 


a oo 
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3.5.3. The Trigonometric Functions 


Now we consider the trigonometric functions. Recall that an angle is usually 
measured in degrees, so that the angle of a full circle is 360°. But for analysis, we 
need to make a change of units to radians. 


Figure 3.13: An arc with central angle 0. 


The number 7 is defined as the ratio of the circumsference of a circle to its 
diameter. Hence, a circle of radius 1 would have circumsference 27. This number 
7m can be shown to be an irrational number. The radian measurement of an angle 
is so that an arc with central angle @ radians on a circle of radius r has length ré, 
so that the circumsference of the circle is 27r. Hence, the conversion between 
degrees and radians is 


Bice cn 
= 1800 4 


Historically, sine and cosine are defined using right-angled triangles, as shown 
in Figure 3.14. 

To extend the definitions of sin @ and cos @ so that @ can be any real numbers, 
we use the unit circle x? +y? = 1. The angle measurement starts from the positive 
x-axis and we take the counter-clockwie direction as positive direction. For any 
real number 0, find a point P(x, y) on the unit circle such that the line segment 
between the origin O and the point P makes an angle 6 radians with the positive x- 
axis (see Figure 3.15). Then we define cos @ and sin 6 to be the x and y coordinates 
of P: 


x= cos 7, y=—sing. 


In this way, the function sin # and cos @ are defined rigorously, and when @ is 
an acute angle, it coincides with the definition using right-angled triangles. From 
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Z\ = © 


Figure 3.14: Classical definitions of sine and cosine functions. 


(a) (b) 
: ae . as on 
Figure 3.15: The definitions of sin 6 and cos 6 for (a) 6 = = and (b) 0 = Tt 


the definitions, it is obvious that sin 6 and cos @ are periodic functions of periodic 
27. 


Definition 3.14 Periodic Functions 


A function f : R — R is said to be periodic if there is a positive number L 
so that 


fe a Be) for allz € R. 


Such a number LF is called a period of the function f. If L is a period of f, 
then for any positive integer n, nL is also a period of f. 


From the definitions, it is quite obvious that sin@ and cos@ are continuous 
functions. A rigorous proof is tedious. To show that these two functions are 
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differentiable is also possible, but complicated. Two crucial formulas are 


sin(@; + 02) = sin 0; cos 02 + cos 9; sin 42, (3.9a) 
cos(@; + 02) = cos 0; cos 62 — sin 6; sin Oo. (3.9b) 


The proofs of these two formulas by elementary means are tedious. 

In this section, we are going to define the sine and cosine functions using a 
different approach. We will show that the functions thus defined agree with the 
old definitions. 


First, we present an existence and uniquess theorem. 


Theorem 3.32 Existence and Uniqueness Theorem 


Let a and ( be any two real numbers. There exists a unique twice 


differentiable function f : R — R satisfying 


f"(x) + f(x) =9, 


Again, the proof of the existence requires knowledge from later chapters. We 
will prove uniqueness here. We begin by a lemma that will be useful later. 


Lemma 3.33 


R be a twice differentiable function that satisfies 


f"(x) + f(z) =0. 
The following holds. 


1. f is infinitely differentiable. 


2. For any positive integer n, the n™ derivative of f, g(x) 


satisfies 
g (2) + g(x) =0. 


3. The function f(x)? + f’(a)? is a constant. 
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Since f is twice differentiable, f is continuous and differentiable. Since 
f"(x) = —f (x), f” is continuous and differentiable. This implies that f is 
three times differentiable and f’” = —f’. Continue arguing in this way, we 
find that f is infinitely differentiable, and for any nonengative integer n, 


leap = =f) (x). 


The latter says that if g = f, then 


g(x) + g(x) = 0. 


These prove the first and second statements. For the third statement, we 
notice that 


(F(a)? + F(a)?) = F@)F"a) + F@)s@) 
= 2f'(«) (F"(«) + F()) =0. 


This implies that f(x)? + f’(x)? is a constant. 


Now we return to Theorem 3.32. 


Proof of Theorem 3.32 
If f; and f2 are two functions that satisfy the given conditions, then the 


function f = (f; — fo) : R > Ris a twice differentiable function satifying 


f"\x) + F(x) =0, 


To prove uniqueness, we only need to show that this function f/ must be 
identically zero. By Lemma 3.33, there is a constant C’ such that 


f(x)’ + f(x) =C. 


Setting x = 0, we find that C' = 0. Hence, 


fi(x)’ + f(x)’ =0. 
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Since the square of a nonzero number is always positive, we must have 


forallz ER. 


Notice that for a function f : R — R that satisfies f”(x) + f(x) = 0, we have 
fO(e) = —f"(e) = f(e). 
This implies that for all positive integers n, 
FEM(x) = fla), FEM (a) = f'(2), 
fra) = f(a), fE(a) = f"(a). 


If f is the unique solution to 


f"(a) + f(z) = 0, f(0) =a, f'(0) = 8, 
then its derivative g = f’ is the unique solution to 
g(x) + g(x) = 0, g(0) = 8, g'(0) = -a. 
Definition 3.15 The Sine and Cosine functions 


The sine function S(x) = sina is defined to be the unique twice 
differentiable function satisfying 


Sia AS =0, SO) =o, HOS 


The cosine function C(a) = cosx is defined as the derivative of S(x). 
Namely, C(x) = S’(x). It is the unique twice differentiable function 
satisfying 


C'(2)+C(z)=0,  C(0)=1, C’(0)=0. 


Notice that once we prove the existence of the function S(x) = sin z, then the 
function C(x) = cos x exists. One can then check that the function 


f(x) = aC (x) + BS(x) 
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is a twice differentiable function satifying 


f"(x) + f(z) =, f(0) =a, f'(0) = 8B. 


In other words, to prove the existence part in Theorem 3.32, we only need to 
establish the existence of the function S(a) = sinz. 
In the following, we establish the properties of the functions S(x) and C(x). 


Theorem 3.34 


The functions S(z) and C'(a) are infinitely differentiable functions that 
satisfy the following. 


(a) S’(x) = C(x) and C’(x) = —S(a) forall az € R. 


(b) S(a) is an odd function, C(x) is an even function. 


(c) S(x)? + C(x)? =1 forallz ER. 


(d) For any real numbers x and y, S(x + y) = S(x)C(y) + C(x) S(y). 


(e) For any real numbers x and y, C(a + y) = C(x)C(y) — S(x)S(y). 


S'(x) = C(x) is by the definition of C(x). Differentiating gives C’(x) = 
S" (x) = —S(x). To prove (b), one check that the function f(z) = —S(—z) 
satisfies f’(x) + f(x) = 0, f(0) = 0 and f’(0) = 1. By uniquess of the 
function S(a), we have f(x) = S(x), which proves that S(x) is an odd 
function. Since C(x) = S’(x), C(x) is an even function. Lemma 3.33 says 
that S(a)? + S’(a)? is a constant. Hence, there is a constant A such that 


Sia)? +Cizyry =A for all x € R. 


Setting x = 0 gives A = 1. This proves part (c). For part (d), fixed a real 
number y and consider the function 


f(x) = S(a + y). 
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We find that 


i) = S eae a = Cle 
COE) = See) 42 Se se) =O, 


and 


Since the function g(7) = S(y)C(a) + C(y)S(2) satisfies 


g(x) + g(x) = 0, 


by uniquesness, we find that f(a) = g(x) for all z € R. Therefore, 


S(a+y) = S(x)C(y) + C(#)S(y). 
Differentiate with respect to x gives 


C(a + y) = C(a)C(y) — S(a)S(y). 


Here we have used advanced analytic tools to prove the identities (3.9) in a 
simple way. Part (c) in Theorem 3.34 says that 


sin? x + cos?x = 1 forall zx ER. 


This implies that 


sme) <1, |cosz| <1 for all z € R. 


By definition, sinO = S(0) = 0 and cos0 = C(0) = 1. What is not obvious is 
that 0 is in the range of C(x). 


Theorem 3.35 


There is a smallest positive number wu such that C'(u) = 0. 
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Since S() is differentiable, we can apply mean value theorem to conclude 
that there is a point v in (0, 2) such that 


S(2) — S(0) 


Sap = Se) =O). 


This gives 
1 
IC@)| = 1S@)| < 
By part (e) and part (c) in Theorem 3.34, 


C(2v) = Cw)? — S(v)? = 20(v)? -1< 5-1<0. 


Since C(2v) < 0 < C(O), and C(z) is a continuous function, intermediate 
value theorem implies that there is a point w in (0, 2v) such that C(w) = 0. 
Let 

A= {ve UC) — 0 


We have just shown that A is a nonempty set. By definition, A is bounded 
below by 0. Hence, u = inf A exists. By Lemma 1.34, there is a sequence 
{w,} in A that converges to u. Since C(x) is continuous, the sequence 
{C'(wn)} converges to C(u). But C(w,) = 0 for all n. Hence, C(u) = 0. 
Since C(0) = 1, u # 0. Hence, u > 0. This proves that wu is the smallest 
positive number such that C'(u) = 0. 


Let u be the smallest positive number such that C'(u) = 0. Then we must have 
C(x) > 0 for all x € [0,u). Since S’(x) = C(x), S(x) is strictly increasing on 
(0, uJ. Thus, S(x) > 0 for all x € (0,u]. This, and S(u)? + C(u)? = 1, implies 
that S(u) = 1. From part (d) and part (e) in Theorem 3.34, we find that 
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It follows that 


S(a+2u) = C(a +u) = —S(z), 
C(a+2u) = —S(a#+u) = —C(z) 
S(a + 3u) = C(a + 2u) = —C(z), 
C(a# + 3u) = —S(x+ 2u) = S(z) 
S(a + 4u) = C(x + 3u) = S(z), 
C(a+ 4u) = —S(x + 3u) = C(z). 


The last pair of equations show that S(x) and C() are periodic functions of 
period 4u. Since S(a) > 0 and C(x) > 0 for x € (0,u), we have the following. 


e Forz € (0,u), C(x) > 0, S(a) > 0. 

e Forz € (u,2u), C(x) < 0, S(x) > 0. 
e Forz € (2u,3u), C(x) < 0, S(x) < 0. 
e For € (3u,4u), C(x) > 0, S(x) < 0. 


Together with S(0) = 0, C(0) = 1, S(u) = 1, C(uw) = 0, we find that S(2u) = 0, 
C(2u) = —1, S(3u) = —1, C(3u) = 0. These imply that for every P(x, y) on 
the unit circle x? + y* = 1, there is a unique 0 € [0, 4u) such that 


C= CO): eS Sah 


What is not obvious is that this 6 is exactly the radian of the angle that the line 
segment OP makes with the positive x-axis. To show this, we can argue in the 
following way. Assume that an object is travelling on the circle x? + y? = 1, and 
its position at time t is (a(t), y(t)), where 


= CE). “ya Sit) 


It follows that the velocity of the object at time t is (x’(t), y/(t)), where 


This implies that the speed is 


Vai(t? + y(t)? = VS(t? + C(t)? = 1. 
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Hence, the object is travelling at a constant speed 1. The distance travelled up to 
time ¢ is then t. This proves that the arclength of the arc from (1,0) to the point 
P(C(t), S(t)) is t. Then t must be the radian of the angle OP makes with the 
positive x axis. Hence, the functions C(t) and S(t) coincide with the classical 
cost and sint functions. Having proved this, by the definition of 7, we have 


2Uu=T. 
Hence, we can summarize the facts above as follows. 


Properties of the Sine and Cosine Functions 


The functions S(x) = sina and C(x) = cosa are 27 periodic infinitely 
differentiable functions. 


— sinx = cos 2, —cosxz = —sinz. 
ae ae 
Moreover, they have the following properties. 
: eh ne 
1. sin Ge + =) = COS Z, COS (x + =) = —sing. 
. sin(z +7) = —sinz, cos(% +7) = —cosz. 
: 3n\) _ _ Bye \ ee 
. sin (a + 3n) = — COS Z, COS (a a ) — slg. 
. sin z is an odd function, cos x is an even function. 


. sinxz = 0 if and only if x = nz, where n is an integer. 


. cos x = Oif and only if x = (n > t) 7, Where n is an integer. 


There are four other trigonometric functions. They are defined in terms of 


sin x and cos x in the usual way. 
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Figure 3.17: The cosine function C(x) = cos x. 


Definition 3.16 Trigonmetric Functions 


The tangent, cotangent, secant and cosecant functions are defined as 


The following are easy to derive. 


Proposition 3.36 


tan x, cot x, sec x and csc x are infinitely differentiable functions with 


A = sec’ 2, Sei — ee ae. 
He 


dx 


—secxv = secx tang, eee EI 
x 


dx 
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Figure 3.18: The function f(x) = tanz. 


Before closing this subsection, we want to prove some important limits and 


inequalities for the function sin x. 
Theorem 3.37 


. For any real number 2, | sin z| < |2}. 


. For any x € [0, 7/2], 


—x <sinx <2. 
T 


When x = 0, sinx = 0 and | sin z| < |z| is obviously true. If 4 0, mean 
value theorem implies that there is a number c in (0, 1) such that 


sin & sin x — sinO0 


= = ' 312 
7 =a) cos(cx) (3.12) 
Hence, ; 
|= leosten)ii< 1, 
i 


which implies that | sin z| < |x|. This proves the first statement. 
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For the second statement, the definition of derivative implies that 


. sina _ sinz—sin0 d 
lim = lim = 


= sin x = cos0 = 1. 
z>0 2£ x—0 gz —O0 dx pO 


For the third statement, define the function g : [0, 5] + R by 


sin x& 


Then g is continuous on (0, 5], and differentiable on (0, 5), with 


; TeCUs = iSIb a sin T 
ge N= 5 = cos % — when 0 <2 < =. 
x a Be 2 


As before, for each x € (0, 5], mean value theorem implies that there is a 
u € (0, x) such that 
sin 
= COS U. 
Since 0 < u < x and the cosine function is strictly decreasing on (0, 5), 
we find that 


1 1 
ae) = —(cosx — cosu) < 0. 
x x 


This shows that g : [0,5] — R is a strictly decreasing function. Since 


g(0) = 1 and g(%) = 2, we find that for all x € (0, 3], 
sin © 


< esl, 
o 


Thus, for all x € [0, 7/2], 


2) ; 
—x% <sing <a. 
T 


3.5.4 The Inverse Trigonometric Functions 


In this section, we are going to define inverse functions for sin x, cos x and tan x. 


Since trigonometric functions are periodic functions, they are not one-to-one. 
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Hence, we cannot find their inverses over the whole domain of their definitions. 
However, we can restrict each of their domains to an interval on which each of 
them is one-to-one to define the inverse. Such interval should contain the interval 
(0, 7/2) which is where these functions are classically defined. 


e The largest interval that contains the interval (0, 7/2) and on which sin x is 


one-to-one is [—4, 5]. 


e The largest interval that contains the interval (0,7/2) and on which cos x is 


one-to-one is {0, 7]. 


e The largest interval that contains the interval (0, 7/2) and on which tan x is 
one-to-one is (—4, 5). 
Definition 3.17 Inverse Sine Function 
The function sin~* x is a function defined on [—1, 1] and with range [—, 3] 
such that 


silo (sian) —= oh for all x € {[—1, 1]; 
TNT 


eee ye 
= for all l->, =| . 
sin (sing) — 2 orallz € |—315 
Definition 3.18 Inverse Cosine Function 
The function cos! x is a function defined on [—1, 1] and with range [0, 77] 
such that 
cos(cos) x) — =z for all x € [—1, 1]; 


cos ‘(cos 2) = x for all x € [0,7]. 


Definition 3.19 Inverse Tangent Function 


The function tan~! x is a function defined on R and with range (—$, 5) 
such that 


tan(tan’' x) =x for all x € R; 


tan ‘(tanz) = x for all x € (-5, =| : 
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The differentiability of the inverse trigonometric functions and their derivative 


formulas follow immediately from Theorem 3.8. 


Theorem 3.38 


R is a differentiable function with 


1 
Jl — 2? 


Theorem 3.39 


R is a differentiable function with 


4 1 
—cos “= 


dx Jl — 2? 


Theorem 3.40 


R is a differentiable function with 


= fan 7 = 


dx 
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Exercises 3.5 


Question 1 


Determine the following limits. 


(a) lim (1 = a 
noo n 
(b) lim (1+ 2)" 
noo nN 


(c) lim (1 oe aN 
Noo nN 


Question 2 

For any x € [—1, 1], show that sin~' z + cos"! z is a constant and find this 
constant. 

Question 3 


Determine the following limits. 


(a) lim tanz 
at 


(b) lim tanz 
a>—3t 


(c) lim tanta 
wL—-—Oo 


(d) lim tan7! ax 
r—00 
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Question 4 


Consider the function f : R — R defined by 
ec! ' 
sin (=) : Wee 210) 
x 
0, lel) 


Determine whether f is a continuous function. If not, find the points where 
the function f is not continuous. 


Question 5 


Consider the function f : R — R defined by 


Show that f is a continuous function. 


Question 6 


Consider the function f : R — R defined by 


IR — R be the function defined by 


g(x) =a + f(a). 


(a) Show that f is a differentiable function. 


(b) Show that f’ : R — R is not continuous. 


(c) Show that g'(0) = 1, but for any neighbourhood (a, b) of 0, g : (a,b) > 


R is not increasing. 
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3.6 L’ Hopital’s Rules 


In this section, we will apply the Cauchy mean value theorem to prove the I’ 
Hopital’s rules. The latter are useful rules for finding limits of the form 


lim ie) 
wx0 g(x)’ 


when we have one of the following two indeterminate forms. 


1. Type 0/0, where lim f(a) =0Oand lim g(x) =0. 
LLOQ 


L—>XO 


2. Type co/oo, where lim f(x) = oo and lim g(x) = oo. 
xL->xLO xL->xrO 


Here x9 can be oo or —oo. 
Let us first prove the following special case. 


Theorem 3.41 


Let f : (a,b) + Rand g : (a,b) — R be differentiable functions that 
satisfy the following conditions. 


Gi) lim f(x) = lim g(x) =0. 


at raat 


Gi) lim ea 
rat g(x) 
Ta) 


Then lim —~<~=L 
x—at Gg z) 


The condition (i) implies that we can extend f and g to be continuous 


functions on [a,b) by defining f(a) = g(a) = 0. Then by Cauchy mean 


value theorem, for any x € (a,b), there is a point u(x) € (a,x) such that 


(3.13) 
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Since 


OW ar, 


squeeze theorem implies that 


ibnen aus) 0, 
zat 


By limit law for composite functions, we find that 


fiu(e)) _ jy FY) 


rat gi(u(z)) wer gf(u) 


By (3.13), this proves that 


It is easy to see that an analogue of Theorem 3.41 holds for left limits. Combine 
the left limit and the right limit, we have the following. 


Theorem 3.42 |’ Hopital’s Rule I 


Let xo be a point in the open interval (a,b), and let D = (a, b)\ {xo}. Given 
that f : D — Rand g : D — R are diferentiable functions that satisfy the 
following conditions. 


Then we have lim He) = IL 
xL—->XxO g(x) 


We return to a problem that we discussed earlier. 
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Example 3.20 


Determine the limit 


if it exists. 


Solution 
Let f(x) = x79 + 22° — 3 and g(x) = x’ — 1. Then 


io ie) je 0) and Iho (4 =o 


z—1 r—1 
f and g are continuously differentiable functions with 
ie — 20a, Sellen. and 


f(a) 


xl g(x) 


’ Hopital’s rule implies that 


Let us look at some other examples. 


Example 3.21 


Determine whether the limit exists. If it exists, find the limit. 


cae le 
(a) lim ——_——* 
z—0 
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Solution 


(a) This is a limit of the form 0/0. Applying 1’ Hopital’s rule, we have 


ev 


lim 
x0 42 


Again, we have a limit of the form 0/0. Applying I’ Hopital’s rule 


again, we have 


(c) This is a limit of the form 0/0. Applying |’ Hopital’s rule twice, we 
have 


. cos2x — 1 _ —2sin 2x . —4cos 2x 
lim = lim = lim = —?2. 
x0 ee? x0 22x x0 » 


Using I’ Hopital’s rule, we can give a second solution to Example 3.19. 
Example 3.22 
Since f is continuous, we have 
lim (f(xo +h) + f(o — hk) — 2f(zo)) = 0. 
Since we also have lim h? = 0, we can apply |’ Hopital’s rule to get 


fm 2 (20+ 2) + F (xo — h) — 2F (x0) = in fi(xo +h) — Filo — fh) 


h—0 h? 2h 


Since f’ is continuous, 


him Ge Gop aF h) a f' (xo — h)) = (i), 


= 
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Since we also have lim (2h) = 0, applying Il’ Hopital’s rule again give 
_ 


! — _ " " = 
fa J (Go + h) — f/(2o — hi) = iin ceo ae hy) 
h—0 2h h0 2} 


It follows from the continuity of f” that 


fam £At0 +h) + "(0 — hy) 
h-0 2) 


=e ee (x0) , 
These prove that 


h =h)= 


In the future, we are going to see that Taylor’s approximation is an alternative 
to l’ Hopital’s rule when the point po is finite and the indeterminate form if of the 
type 0/0. However, when 2 is infinite or the indeterminate form is of type 00/00, 
l’ Hopital’s rule becomes useful. 

The following is for the case where 2p is infinite, and the limit is of the form 
0/0. 


Theorem 3.43 |’ Hopital’s Rule II 


Let a be a positive number. Given that f : (a,oo) + Rand gq: (a,oo) > 
are diferentiable functions that satisfy the following conditions. 


(i) lim fe ating (a — 0 


xL—->0o 


Gi) im 2 = 7 
L200 g(x) 


Then we have lim HS) = IL, 
a-r00 g(x) 
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Let b = 1/a, and define the functions f; : (0,b) > | 


by 


Then f, and g, are differentiable functions and 


1 1 
/ _ / 
fla)=-39 (2). 
Moreover, 


xz—0+ 


and 


By Theorem 3.41, 


This implies that 


Let us look at the following example. 


Example 3.23 


atl 
) exists. If it exists, find the 


Determine whether the limit lim ( 


L—-0o 


r+2 
limit. 


This is not of the type 0/0. But the logarithm of it can be turned into that form. 


Chapter 3. Differentiating Functions of a Single Variable 234 


Solution 


£ +1 x 
= 1)1 ———— |]. 
5) as ym (5) 


When x — oo, we have something of the form oo - 0. We turn it to the 
form 0/0 by 


Consider the function 


oe » (=) z pe Sey 


xr+l1 xr+1 


l’ Hopital’s rule implies that 
1 


limo (ee) lim E_uit2 
«LOO xL—>CO 


(x +1)? 
aed 
= —2 lim [SS 
roo | + 2a 
== 


By continuity of the exponential function, we have 


a+1 
a ) = lim e%) = exp (Jim g(c)) ae 4, 
2 L000 


xL—- Co 


renee (3.14) 


This is a limit of the form oo/oo. One may say that we can turn it to a limit of the 
form 0/0 by writing 


—x 


x e€ 


ee gl 
Then |’ Hopital’s rule says that if the limit 


(3.15) 
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exists and is equal to L, the limit (3.14) also exists and is equal to L. However, the 
limit (3.15) is more complicated than the limit (3.14). So this strategy is useless. 
Hence, there is a need for us to consider the oo/0oo indeterminate case. We only 
prove the theorem in the case Zo is finite. The case where 79 is infinite can be 
dealt with in the same way as in the proof of Theorem 3.43. 


Theorem 3.44 I’ Hopital’s Rule III 


Let xo be a point in the open interval (a,b), and let D be the set D = 
(a,b) \ {ao}. Given that f : D > Randg: D — R are diferentiable 
functions that satisfy the following conditions. 


Ce limaiyy (ee 9 liming oc: 


L—->XO H be at 0) 


Gi) lim 2 oS 
aro g! (2) 
f(x) 


Then we have lim ——~ = L 
ano g(x) 


The proof of this theorem is technical because of the infinite limits. The 
strategegy to rewrite this as 


Lge) 
veo 1/F(@) 


is not useful, as have been demonstrated in our discussion before this theorem. 


f(@) 


We will prove that the right limit lim, Fey is equal to L. The proof that 
ra, Ge 
the left limit is equal to L is similar. Observe that if we fix a point u in 


(xo, 6), then for any x in (xo, u), Cauchy mean value theorem asserts that 


there is a c, in (x, u) such that 


f(a) = fw) 
g(x) — gu) 
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This implies that 


Fixed ¢ > 0. By assumption of 


lim Je) = 


aa g'(z) 


there exsits a 6; > O such that (2,29 + 61) C (a,b), and for any x € 
(Xo, Lo ar 01), 


/ 

AC ec 
g(x) 3 

Take u = %p + 6,/2. Since lim g(x) = oo, we find that 

H ior 4 10) 


fam Lt) = Eglw) 


= (0), 


Therefore, there exists a number 6 such that 0 < 6 < 6,/2, and for all 
x E (£0, Xo + 9), 


2D 


fe — glu) 
g(x) 


pLOee 20) 

g(z) 3 
If x is in (4%, %p +4), Lo < x < wand hence xp < c, < u< 2 + 6. This 
implies that 


Eq. (3.16) then implies that for all x € (x9, 79 + 6), 


g() — g(u)| | f'(ce) 
a(t) || ge) | Io'ce) 


Rep nae 
oa 


f(u) — Lg(u) 
g(x) 


-1]+| 
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This proves that 


f(a) 


im 


Notice that in the proof, we do not use the assumption that jim 1(2) = ve, 
Hence, this can be ommited from the conditions in the theorem. If f (x) is bounded 
in a neighbourhood of xo, there is no need to apply |’ Hopital’s rule. 

Let us now look at some examples. 


Example 3.24 


Let r be a positive number. Prove that 


Deduce that for any positive number s, 


lim z*e ” 


Solution 
The limit 


Since lim e” = oo, and the function f(a) = «* is a continuous function, 
L— Oo) 


we find that 
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The result of this example shows that when x becomes large, 
e ln goes to infinity slower than any positive powers of x; 


e any positive powers of x goes to infinity slower than e”. 


Example 3.25 


Show that there exists a number c so that the function 


if xe > 0, 
ify — 0, 


is continuous. 


Solution 
Since 
i te | when x > 0, 


f (x) is continuous on (0, co). To make f continuous, f must be continuous 
at x = 0. This means 


C= CO = lin Gs) = lin 29 


x—0+F x0t 


Let us look at the limit lim, zlnz. It is of the form 0 - oo. We turn it to 
xr—0 


the form 00/00, and use I’ Hopital’s rule. 


lim zlnzg= lim 
20+ az—0t 


Irak 98 
nie 
x 


Therefore, when 


C= O20) ( lim vine’) = 


20+ 


the function f : [0,0o) — R is continuous. 
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Exercises 3.6 


Question 1 
Determine whether the limit exists. If it exists, find the limit. 


100 ae 9 =% 


(a) li 


im 
a1 3x19! + 4755 — Tx 


em — 2-27: 
(b) a x? + 323 
t —1 
(@y im 22 = 
x0 Ge 


tanz — 2x 


in 


Question 2 


Find the limit 


Question 3 


Let r be a positive number. Prove that 


lim z’ lnz =0. 
x20 


Question 4 


Determine whether the limit exists. If it exists, find the limit. 


x* In(1+ 2) 
u 


Chapter 3. Differentiating Functions of a Single Variable 240 


3.7 Concavity of Functions 


In this section, we study concavity of functions. If a function is twice differentiable, 


its concavity is determined by the second derivative. 


Recall that if x; and x2 


in the interval |0, 1], 


are two points in R, then as ¢ runs through all numbers 


y+ t(x2 = £1) = (1 = tay + xo 


runs through all points in 


the interval [x,, x72]. We say that a subset S of R is 


convex if and only if for any two points x, and x in S, and for any ¢ in (0, 1], the 


point (1 — t)a, + tae is also in S. We have proved that a subset of R is convex if 


and only if it is an interval. 


Definition 3.20 Concavity of Functions 


Let J be an interval. 


1. A function f : I > 


R is concave up (or convex) provided that for any 


two points x; and x2 in J, and for any ¢ € 0, 1], 


iil 


t)ay + taxa) < (1—t)f (a1) + tf (22). 


2. A function f : [> 


R is concave down provided that for any two points 


x, and X2 in I, and for any ¢ € [0, 1], 


(Ul 


t)ay + tra) > (1—t)f (a1) + tf (x2). 


. Afunction f : [> 


R is strictly concave up (or strictly convex) provided 


that for any two distinct points x; and x2 in J, and for any t¢ € (0,1), 


(es 


t)a, + tae) < (1—t)f (a1) + tf (22). 


. A function f : J — R is strictly concave down provided that for any 


two distinct points x, and x2 in J, and for any t € (0, 1), 


ie 


t)a, + ta) > (1—t)f(a1) + tf (x2). 
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Notice that a function f : J — R is concave up if and only if the function 


—f : I + Ris concave down. Same for the strict concavity. 

Geometrically, we draw a line L passing through the points P (a1, f(21)) and 
P(x, f(x2)) on the graph y = f(x). If the equation of this line L is y = g(x), 
and 2% = (1 — t)x, + to, then 


g(Xo) = (1—t) f (x1) + tf (x2). 


Hence, (20, g(2o)) is point on the line L. Therefore, a function y = f(x) is strictly 
concave up if its graph is always below a line segment joining two points on the 
graph; and it is strictly concave down if its graph is always above a line segment 
joining two points on the graph. 


y yx) 


Figure 3.19: (a) A strictly concave up function. (b) A strictly concave down 
function. 


Example 3.26 


For any constants m and c, the function f(#) = max + c is concave up and 
concave down. It is neither strictly concave up nor strictly concave down. 


Example 3.27 


Show that the function f : | R, f(x) = x? is strictly concave up. 
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Solution 
Let x, and x2 be any two distinct real numbers, and let ¢ be a number in the 
interval (0, 1). Then 


f((1 — t)x, + tae) — (1 — t) f (a1) — tf (x2) 
= (= too, P20 aie te 1 ee 
=i l=—t)r; + 2 — tz 75 — 11 — 2), 


— —t(1 = t)(x1 a £9). 
Since (x; — 2)? > 0, t > 0 and 1 —t > 0, we find that 
f((1 —t)a1 + tx2) — (1 —t)f (a1) — tf (22) < 0. 


This proves that f is strictly concave up. 


In the definition of concavity, we do not assume any regularity about the 
function. If a function is differentiable, we can characterize the concavity of the 
function in terms of its tangent lines. 

For a point xo € (a,b), the equation of the tangent line to the curve y = f(x) 
at © = Yo IS 

y = f (x0) + f'(xo)(x — 20). 


We say that the graph of f is above the tangent line at x = xo provided that 
f(x) > f(ao) + f’(x0)(x — 20) for all x € [a, 0). 


We say that the graph of f is strictly above the tangent line at x = xo except at the 
tangential point provided that 


f(x) > f (xo) + f’(x0) (x — 20) for all x € [a,b] \ {zo}. 


Similarly, one can define what it means for the graph of f to be below a tangent 
line, or strictly below. 
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Theorem 3.45 


Let f : [a,b] — R be a function that is continuous on [a,b], and 


differentiable on (a,b). The following three conditions are equivalent. 
(a) f’ is strictly increasing on (a, b). 


(b) The graph of f is strictly above every tangent line except at the 
tangential point. 


(c) f is strictly concave up. 


First we prove (a) = > (b). Take any xg € (a,b). The equation of the 


tangent line at x = Zo is 
y = g(x) = f (x0) + f'(xo)(x — 20). 


If x € [a,b], 


f(x) — g(x) = f(x) — f(@0) + f"(@o)(# — 20). 


When x # 2, mean value theorem implies that there exists wu strictly 
between 2p and x such that 


f(z) — f (xo) = f’(u)(@ — 20). 


Therefore 

12) — Ga) — |e — an) (4) — F (aa) 
Ifa <x < x, u < x and so f’(u) < f’(x9). This implies that f(x) — 
g(x) > 0. If x > xo, u > Xo and so f’(u) > f’(ao). Then we also have 
f(x) — g(x) > 0. In other words, we have proved that for any zo in (a, b), 
for any x € [a, 6] \ {zo}, 


VL a) Se ie eae = tea) 
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This proves that the graph of f is strictly above every tangent line except at 
the tangential point. 

Next, we prove (b) ==> (c). Given x, and 2 in [a,b] with x, < x2, and 
t € (0,1), let rp = (1 — t)x, + tag. Then x1 < x < Xo, and 


G1—-%=—t(a,—-%),  s2—20=(1—-2)(m— 2). 
By assumption, 
f(a1) > F(wo) + f'(wo)(e1 — Bo) = F(%0) — tf'(20)(t2 — 21), 
f (x2) > f (v0) + f'(xo) (2 — Zo) = f (to) + (1 — t) f’ (20) (2 — 21). 
Therefore, 
(1—t)f (a1) +tf (wo) > feo) = f((1 — t) a1 + tara). 


This proves that f is strictly concave up. 

Finally, we prove (c) = > (a). First we will prove that f’ is increasing 
on (a,b). Given x; and x» in (a,b) with 7; < x2, we want to show that 
f'(a1) < f'(x2). For any x € (21, 2X2), there exists t € (0,1) such that 
x = (1—t)x, + tre. Since f is strictly concave up, we have 


f(a) = f((1 — thai + tae) < (1 — t)f (a1) + tf (a2). 
This implies that 
(1 — t)(F(@) — F(ai)) < t(f (#2) — fx). 


Since x — 4, = t(xg — 21) and x2 — x = (1 — t)(x2 — 21), we have 


Ce Ga) S flw2) — F(x) 


Io — Jb dbo — ae 


(3.17) 


Letting x > a} in (3.17), we find that 
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Letting x + x, in (3.17), we find that 


These prove that 


(Ga) 2 ft ay. 


In other words, we have proved that f’ is increasing on (a,b). If f’ is not 


strictly increasing on (a, b), there exist x; and x2 in (a, b) with x; < x2 but 
f'(a1) = f' (a2). Since f’ is increasing, we will have f’(x) = f’(a1) = 
f'(x2) = m for all x € (21, £2). This implies that 


{(@)= mec for all x € [21, 29]. 
But then for any ¢ € (0, 1), 
F((l— tai tne) =m |(1 —7)ay + tee] +b = (1 — 2) F(a) + tf (22), 


which constradicts to the strict concavity of f. Therefore, f’ must be strictly 


increasing on (a, b). 


By replacing f by —f in Theorem 3.45, we obtain the following immediately. 


Theorem 3.46 


Let f : [a,b] — R be a function that is continuous on [a,b], and 


differentiable on (a,b). The following three conditions are equivalent. 


(a) f’ is strictly decreasing on (a, b). 


(b) The graph of f is strictly below every tangent line except at the 


tangential point. 


(c) f is strictly concave down. 


In Theorem 3.45, if we relax the strictness, the proofs are actually easier. 
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Theorem 3.47 


Let f : [a,b] — R be a function that is continuous on [a,b], and 


differentiable on (a,b). The following three conditions are equivalent. 
(a) f’ is increasing on (a, b). 
(b) The graph of f is above every tangent line. 


(c) f is concave up. 


Theorem 3.48 


Let f : [a,b] — R be a function that is continuous on [a,b], and 
differentiable on (a,b). The following three conditions are equivalent. 


(a) f’ is decreasing on (a, b). 
(b) The graph of f is below every tangent line. 


(c) f is concave down. 


If a function is twice differentiable, we can characterize concavity using second 
derivatives. 


Theorem 3.49 


Let f : [a,b] — R be a function that is continuous on [a,b], and twice 
differentiable on (a, b). 


1. f(x) is concave up if and only if f”(x) > 0 for all x € (a, 0). 


2. f(x) is concave down if and only if f”(x) < 0 for all x € (a,b). 


3. If f”(x) > 0 for all x € (a,b), then f is strictly concave up. 


4. If f’(x) < 0 forall x € (a,b), then f is strictly concave down. 
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For (a) and (b), this is just the fact that f’(x) > 0 for all x € (a,b) if and 
only if f’ is increasing; f”(a) < 0 for all x © (a,b) if and only if f’ is 


decreasing. 

For (c) and (d), we note that f”(x) > 0 for all x € (a,b) implies that f’ is 
strictly increasing on (a,b); while f”(x) < 0 for all x € (a,b) implies that 
f’ is strictly decreasing on (a, b) 


We have seen that if a differentiable function g : (a,b) — R is strictly 
increasing, it is not necessary that g'(x) > O for all x € (a,b). This is why 


for f : (a,b) — R to be strictly concave up, it is not necessary that f’(x) > 0 for 


all x € (a,b). The function f : R — R, f(x) = x* gives an example of a function 


that is strictly concave up, but it is not true that f”’(2) > 0 forall z € R. 


Example 3.28 


Show that the function f : [0,7] > R, f(x) = sinz is strictly concave 
down. 


Solution 
Since f’(x) = —sinz < 0 forall x € (0,7), we find that f : [0,7] > 1 
f(x) = sin z is strictly concave down. 


Example 3.29 


Consider the power function f(x) = x". Since f"(x) = r(r — 1)x"~*, we 


have the following. 


1. Whenr < 0, the function f : (0,00) > R, f(x) = x” is strictly concave 
up. 


. When 0 < r < 1, the function f : [0,00) > R, f(x) = 2” is strictly 
concave down. 


. When r > 1, the function f : [0,00o) > R, f(x) = 2" is strictly concave 
up. 
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Next we look at a classical example where the concavity of a function can be 
used to prove inequalities. 


Example 3.30 Young’s Inequality 


Given that p and q are positive numbers such that 


Equality holds if and only if a? = 6%. 


Solution 
Notice that since p and q are positive, we have 1/p < 1 and 1/q < 1. This 


implies that p > 1 and q > 1. Consider the function f : (0,co) > R, 
f(x) = Ina. We find that 


for all x > 0. 


Hence, the function f : (0,00) > R, f(x) = Inz is strictly concave down. 
This implies that for any two positive numbers x, and x2, and any t € (0, 1), 


In ((1 — t)a, + tag) > (1-2) Ing, +tln gp. (3.18) 


The equality can hold if and only if 7; = x. Now, let t = 1/q. Then 
t € (0, 1) and 1 — t = 1/p. Given the positive numbers a and 8, let 


Se, ey 


Then x, and x2 are positive numbers. Eq. (3.18) implies that 


Pp q 1 1 
In (= 4. =) > = Ina? + — nb? = In(ad), 
yo i q 
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with equality holds if and only if a? = b?. Therefore, 


Equality holds if and only if a? = 6%. 
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Exercises 3.7 


Question 1 


(a) Show that the function f : R > R, f(x) = e~* is strictly concave up. 


(b) Show that the function f : (0,7) + R, f(x) = 
up. 


ee 
is strictly concave 
x 


Question 2 


Let f : (a,b) — R be a twice differentiable function. If f : (a,b) — R 
is concave down, and f(x) > 0 for all x € (a,b), prove that the function 
g: (a,b) > R, 


i) 


f(x) 


is concave up. 


Question 3 


Given that the function f : [a,b] > R is concave down. Show that for any 


L1,X2,...,Xn in [a, b], if ty, to,...,t, are nonnegative numbers satifying 
FACE eee een 
then 
f(tiai + tore +--+ + trtn) > tif (xi) + tof (v2) +--+ + trf (en). 


Question 4: Arithmetic Mean-Geometric Mean Inequality 


The arithmetic mean-geometric mean inequality states that if a1, a2,..., dn 
are n positive numbers, then 


Oh) Se Wpy ae oo ap hy 
n 


> W/a102°° + Ap. 


Use the concavity of the function f : (0,00) > R, f(x) = Ina and the 
result of the previous question to prove this inequality. 
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Chapter 4 
Integrating Functions of a Single Variable 


The concept of integrals arises naturally when one wants to compute the area 
bounded by a curve, such as the area of a circle. Since the ancient time, our 
ancestors have found a good strategy to deal with such problems. For example, 
they used the area of polygons to approximate the area of a circle. The circle is 
partitioned into sectors, and the area of each sector is approximated by the area 
of the inscribed triangle (see Figure 4.1). When the circle is partitioned into more 


sectors, better approximation is obtained. 


Figure 4.1: Approximating the area of a circle by the area of a polygon. 


The same idea can be used to find the area enclosed by any curves. This 
motivated the definition of integrals. For curves defined by continuous functions, 
it is not difficult to formulate a well-defined definition for integrals. However, 
mathematicians soon discovered that we need to work with functions that are not 
continuous as well. The process to make integrals rigorously defined is long and 
tedious. We will follow the historical path and study the Riemann integrals in 
this course. This lays down the foundation for advanced theory of integration a 
la Lebesgue. For practical applications and computations, Riemann integrals are 


sufficient and easier to calculate. 
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4.1 Riemann Integrals of Bounded Functions 


In this section, we define the Riemann integral for a function f : [a,b] > R that 


is defined on a closed and bounded interval |a, b|. For this purpose, the function 
is necessarily bounded. In Section 4.6, we will discuss how to deal with functions 
that are not necessarily bounded, via some limiting processes. 

For a closed and bounded interval [a,b], we will always assume that a < b. 
We start by a few definitions. 


Definition 4.1 Partitions 


Let [a,b] be a closed and bounded interval. A partition of |a, b] is a finite 


sequence of points 20, 71, %2,..., 2%, where 
(0) = sey, K Gey Koos K | XK He, = OO. 


It is denoted by P = {xo,%1,...,2,}. Foreach0O <i < k, 2; is a partition 
point. These points partition the interval [a,b] into k subintervals [xo, x1], 


[11,22], ---> [Zp-1, Lz]. The i-subinterval is [2;_1, x;]. 


We have slightly abused notation and used set notation for a partition. 
Example 4.1 


P = {0, 2,3, 5,9, 10} is a partition of the interval [0, 10] into 5 subintervals 


(0, 2], (2, 3], (3, 5], [5, 9] and (9, 10]. 


We use the lengths of the subintervals to measure how fine a partition is. 
Definition 4.2 Gap of a Partition 


Let P = {xo,%1,..., 2%} be a partition of the interval [a, b]. The gap of the 
partition P, denoted by |P| or gap P, is the length of the largest subinterval 
in the partition. Namely, 


|P| = gap P = max {z; — 24-1|1<i<k}. 
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Example 4.2 


For the partition P = {0, 2,3,5,9, 10} of [0, 10], 


[2] sete Pe ee 


A partition where all subintervals have equal lengths is very useful. 


Definition 4.3 Regular Partitions 


Let [a, b] be a closed and bounded interval. A regular partition of [a, b] into 
k intervals is the partition P = {xo,21,..., 2}, where 


b-—a 
k 


|P| = 2 — % = 2g - y= = TR - M1 = 


hike 
This implies that 7; = x +7 F a lage 


Example 4.3 


The regular partition of the interval [0, 10] into 5 intervals is the partition 


P = {0,2,4,6, 8, 10}. 


io 
The gap of this partition is |P| = ae a 2 


Next, we define the Riemann sums and Darboux sums. 


Definition 4.4 Riemann Sums 


Let f : [a,b] + Rbea function, and let P = {xo,21,...,2,} be a partition 
of [a,b]. For each 1 < i < k, choose an intermediate point €; in the i'”- 
subinterval [x;-1, 7;]. Denote this sequence of points {€; be, by A. Then 
the Riemann sum of f with respect to the partition P and the intermediate 


points A = {€;}*_, is the sum 


k 


RG le A) = eG. _ 1-1). 


=) 
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Example 4.4 


Consider the function f : [0,6] + R, f(x) = 6x — x”, and the partition 
P = {0,2,3,5, 6} of [0,6]. Let 


A = {1,3,4,5}. 


RP AVH=5~ 249x148 x 245 1= 40. 


As shown in Figure 4.2, the Riemann sum R(f, P, A) is the sum of 
of rectangles that are used to approximate the region bounded by the c 


6a — x? and the x-axis. 


Figure 4.2: Riemann sum is an approximation of area under a cur 


the areas 
urve y = 


ve. 


In general, if f : [a,b] — R is a nonnegative function, then a Riemann sum 


R(f, P, A) is an approximation to the area bounded by the curve y = 


f(x), the 


z-axis, and the lines x = a and x = b. In its definition, we do not need to 


assume that f is a bounded function. Since Riemann sum involves an 


arbitrary 


choice of points in each subinterval, to give a bound to Riemann sums, we need 


the concept of Darboux sums, whose definition requires f : [a,b] — | 
bounded function. 


R to be a 
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Definition 4.5 Darboux Sums 


Let f : [a,b] — R be a bounded function, and let P = {xo,71,..., x} be 
a partition of [a,b]. For each 1 < i < k, let 


m= inf f(z), M;= sup_ f(z). 


Li-1 SUL; Lj-1 SUL 2; 


The Darboux lower sum L(f, P) and the Darboux upper sum U(f, P) are 
defined by 


> mi( Li Lie 1) 


=o Me Xi — Li-1). 


Remark 4.1 


For convenience, we denote 
int( fe) jae ae) end sips) | ease = et 


by inf f(x) and sup f(x) respectively. The assumption that f is 


Ej-1S2S £41524 


bounded is needed to ensure that m,; and V; exist for all 1 <72< k. The 
reason we use infimum and supremum is obvious, as the function f might 


not have minimum or maximum on an interval. 


Figure 4.3: Darboux lower sum and Darboux upper sum. 
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Example 4.5 


For the function f : [0,6] > R, f(x) = 6x — x? and the partition P = 
{0, 2,3, 5,6} of [0,6] considered in Example 4.4, we find that 


interval | x; — xj_1 mj; M; 


Hence, the Darboux lower sum L(f,P) and the Darboux upper sum 


U(f, P) are 


U(f,P)=0x2+8x14+5x24+0x1=18, 
U(f,P) =8x24+9x149x245x1=48. 


Example 4.6 


If f : [a,b] > Ris the constant function f(a) = c, it is obvious that for any 
partition P = {x;}*_, of [a,b], and for any choices of intermediate points 
A= {& Ua 


CP Ne UG ei (ge ae 1a 


The following can be easily deduced from the definitions. 


Proposition 4.1 


Let f : [a,b] > R be a bounded function such that 


m<f(r)<M foralla< 2 <b. 


For any partition P = {x;}*_, of the interval [a,b], and any choice of 


intermediate points A = {€;}*_, for the partition P, we have 


m(b—a) < L(f,P) < R(f, P, A) < U(f, P) < M(b—a). 
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For any 1 <i < k, let 


1, — ee ey es Spey (2) 


tj-15 050; 


Then 


li Ss Se) A SL, 


Therefore, 


ltl; Te i) SS DA eS Me 
MiG, = 2,1) @ Ve, aa 


Summing over 7 from 2 = 1 to 2 = k, we obtain 


m(b—a) < L(f, P) < R(f, P, A) <U(f,P) < M(b—a). 


For a bounded nonnegative function f : [a,b] + R, if the region bounded by 
the x-axis, the curve y = f(x), the lines x = a and x = b has an area, then a 
Darboux lower sum is always less than or equal to the area, and a Darboux upper 
sum is always larger than or equal to the area. This leads to the fact that a Darboux 
lower sum is always less than or equal to a Darboux upper sum. To prove this for 
any bounded functions, we introduce the concept of refinement. 


Definition 4.6 Refinement of a Partition 


Let P and P* be partitions of the interval |a, b]. We say that P* is refinement 
of P if every partition point of P is also a partition point of P*. In other 
words, the set of points in P is a subset of the set of points in P*. 


Example 4.7 


For the partition P = {0,2,3,5,9, 10} of [0, 10], 


P* = {0,1,2,3,5,6, 8,9, 10} 


is a refinement. 


Chapter 4. Integrating Functions of a Single Variable 258 


tt 5 6 er 


Figure 4.4: A partition P of [0,10] and its refinement P*. 


If P* is a refinement of P = {x,}*_,, then for each 1 < i < k, P* induces a 
partition P; of the interval [2;_1, 2]. 


Example 4.8 


For the partition P and P* in Example 4.7, P* induces the partition P; = 


(OL = Oe ee eS GO ail es = (Ot se 
the intervals [0, 2], [2,3], [3, 5], [5, 9] and [9, 10] respectively. 


Since the union of all the subintervals in the partition P;, 1 < i < k is the 
collection of all the subintervals in the partition P*, the following is quite obvious. 


Proposition 4.2 


Let f : [a,b] + R be a bounded function, and let P = {x;}"_, be a partition 
of [a,b]. Given a refinement P* of P, let P;, 1 < i < k, be the partition that 
P* induces on the interval [x;_1, x;]. Then 


k 


Se) oe) 


i=1 


From this, it is quite easy to obtain the following. 


Theorem 4.3 


Let f : [a,b] + R be a bounded function, and let P and P* be partitions of 


[a, b]. If P* is a refinement of P, then 


FOUTS OU i en) ueSy Cli weg) Sabi yia:): 
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Let P= {a,}"_,. Foreach 1 <7 < k, let 


m= inf F(z), M;= sup f( Ns 


Li-1 SUS; Lji-1 50S; 


Since 
m, < f(x) < M; for all x € [x;_1, 24], 


we find that 
mi(a; ay Li-1) = AG, ify = vig. = M(x; = ay) 


Summing over 7 from | to k gives 


By Proposition 4.2, this gives 


Te See ie) Ui ee), 


wm X =X 


Figure 4.5: When a partition is refined, Darboux lower sum gets larger. 


If P; and P, are partitions of [a,b], a common refinement of P; and P is a 
partition P* which contains all the partition points of P; and P,. Such a common 
refinement always exists. The smallest one is the one whose set of points is the 
union of the set of points in P, and the set of points in Py. 
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Figure 4.6: When a partition is refined, Darboux upper sum gets smaller. 


Corollary 4.4 


Let f : [a,b] — R be a bounded function, and let P and P, be any two 
partitions of [a, b]. Then 


Bf, Pi) = UF, Pa) 


Take a common refinement P* of the partitions P, and P,. By Theorem 
4.3, 


Given a bounded function f : [a,b] — R, we consider the set of Darboux 
lower sums and the set of Darboux upper sums of f. 
Si(f) = {L(f, P)| P is a partition of [a, b]} , 
Su(f) = {U(f, P) | P is a partition of [a, b]}. 


If m and M are lower and upper bounds of f, then 


This implies that the sets S;(f) and Sy(f) are bounded. When we use the 
Darboux lower sums and upper sums to approximate areas, we are interested in 
the least upper bound of the lower sums and the greatest lower bound of the upper 


sums. 
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Definition 4.7 Lower Integrals and Upper Integrals 


Let f : [a,b] > R be a bounded function. 


b 
1. The lower integral of f, denoted by / f, is defined as the least upper 


bound of the Darboux lower sums. 


ie = sup S;(f) = sup {L(f, P) | P is a partition of [a, b]}. 


b 
2. The upper integral of f, denoted by i f, is defined as the greatest lower 


bound of the Darboux upper sums. 


“Pb 
if f = inf Sy(f) = inf {U(f, P) | P isa partition of [a, })}. 


Example 4.9 


For the constant function f : [a.,b] > R, f(a) =c, 
Gee) = NG = c(b—a) 


for any partition P of [a,b]. Thus, S;(f) = Su(f) = {c(b — a)}, and 


[i= [t= «0-0. 


By Corollary 4.4, we have the following. 


Proposition 4.5 


IR be a bounded function. We have 


ea 
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By definitions of infimum and supremum, for any positive integer n, there 
are partition P, and P, such that 


b “pb 
P)> ft-2, UG) < f f+. 


These, together with Corollary 4.4, give the following. 


pb 


b 
ae 


Taking the limit n — oo, we deduce that 


[rvs 


Let f : [a,b] > R be a bounded function, and let P be a partition of [a, b]. 


b aw) 
1. L(f,P) < ft < ie <U(f,P). 


b b 
2.0< is : ft GP) Sone): 


Notice that if wis a number such that 


[ises ft 


then for any partition P of [a,b], 


LiF) Sesu GP), 


As we mentioned above, for a nonnegative bounded function f : [a,b] — | 


R, 


a Darboux lower sum L(f, P) is less than or equal to the area below the curve 


y = f(x), while a Darboux upper sum is larger than or equal to the area, if such 


an area is well-defined. Intuitively, the area would be well-defined if there is a 


single number A that is larger than or equal to all the Darboux lower sums, and 
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less than or equal to all the Darboux upper sums. This is the case if and only if 
the lower and the upper integrals are the same. 


Definition 4.8 Riemann Integrability 


Let f : [a,b] — R be a bounded function. We say that f is Riemann 
integrable, or simply integrable, if 


b “pb 
ei 
In this case, we define the integral of f over [a, b] as 


oe 


It is the unique number that is larger than or equal to all the Darboux lower 
sums, and less than or equal to all the Darboux upper sums. 


Remark 4.2 


If f : [a,b] — R is a continuous nonnegative function, we are going to 


prove that f is Riemann integrable. It follows from our discussions above 
b 


that the integrable / ff is the area bounded by the curve y = f(z), the 


a 
z-axis, and the lines x = a and x = b. 


Leibniz Notation 


In Leibniz notation, the integral of f : [a,b] > R over |a, b] is denoted by 


[ pies. 


Example 4.10 


A constant functon f : [a,b] > R, f(x) = cis integrable and 


[1-0-0 
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Let us look at an example of a function that is not integrable. 


Example 4.11 Non-Integrability of the Dirichlet’s Function 


The Dirichlet’s function is the function f : [0,1] — R defined by 


if x is rational, 


if x is irrational. 


Show that f is not Riemann integrable. 


Solution 
Let P = {x;}*_, be any partition of the interval [0,1]. For any 1 < i < 
k, by denseness of the set of rational numbers and the set of irrational 
numbers, there exist a rational number and an irrational number in the 


interval [x;_1, x;]. This shows that 


ie ME = Il. foralll <i<k. 


= Soto Te = = 0, 
=o Me Li — Li-1) 


This shows that 
St(f) = {0}, Su(f) = {1}. 


Therefore, the lower integral and the upper integral of f are 


fren Fie 


respectively. Since they are not equal, f is not Riemann integrable. 


An interesting question now is what functions are Riemann integrable. Let us 
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first give alternative criteria for Riemann integrability. 


Lemma 4.6 


Let f : [a,b] — R be a bounded function. Then the following are 
equivalent. 


(a) f : [a,b] + Ris Riemann integrable. 
(b) For any ¢ > 0, there exists a partition P of [a, b] such that 


U(f, P) — L(f, P) <e. 


First, let us prove (a) implies (b). If f is Riemann integrable, 


(eff 


Given ¢ > 0, by definitions of lower and upper integrals as supremums and 
infimums, there exist partitions P, and P» of [a,b] such that 


b b 
LP) > f r-§ and UP) < f fs. 


This gives 
Di) = Gi) <€. 


Let P be acommon refinement of P; and P). Then 
GEIS) STU IP) ss UNE Ie) UGE Ie) 
This implies that 
UNG) EG, SS ONC | EI Gi 1) 


Conversely, assume that (b) holds. Then for every positive integer n, there 
is a partition P,, of [a, b] such that 
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Therefore, 


This shows that f is Riemann integrable. 


Theorem 4.7 The Archimedes-Riemann Theorem 


Let f : [a,b] — R be a bounded function. Then f : [a,b] + R is Riemann 
integrable if and only if there is a sequence { P,,} of partitions of [a, b] such 
that 


lim (U(f, Pa) — L(f, P)) = 0. (4.1) 


noo 


In this case, the Riemann integral of f over [a, b] can be computed by 


N—>Co 


iL fF =m — lim CRG 2a) (4.2) 


This theorems says that the Riemann integrability of a function can be checked 
by the existence of a sequence of partitions satisfying (4.1). Such sequence of 
partitions can also be used to compute the Riemann integral. Thus, we give such 


sequence a special name. 


Definition 4.9 Archimedes Sequence of Partitions 


Let f : [a,b] — R be a bounded function. A sequence { P,,} of partitions 


of [a, b] is called an Archimedes sequence of partitions for f provided that 


lim (U(f, P,) — L(f, Py)) = 0. 


n—->oco 


Hence, Theorem 4.7 says that f : [a,b] + Ris Riemann integrable if and only 
if it has an Archimedes sequence of partitions. 
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Proof of Theorem 4.7 
If f : [a,b] + Ris Riemann integrable, by Lemma 4.6, for every positive 


integer n, there is a partition P,, of [a, b] such that 
O<U(f, Pr) — LF, Pa) < 

By squeeze theorem, 
lim (U(f, Pa) — LF, Px) = 0. 

Conversely, if there is a sequence {P,,} of partitions of [a, b] such that 
lim (U(f, Px) ~ LCF, P,)) = 0, 


the definition of limit of sequences implies that for every ¢ > 0, there is a 
positive integer N such that for alln > N, 


ie) — L(f, Pa)| <E. 
In particular, we find that Py is a partition of [a, b] satisfying 
OC ang) te foeian) ae 


By Lemma 4.6 again, we find that f is Riemann integrable. This means 


[3 7 [i =f'r Therefore, 


b 


By taking the n — oo limit, we find that 
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Let us look at an example how to apply the Archimedes-Riemann theorem to 
compute integrals. 


Example 4.12 


Let f : [1,4] — R be the function f(x) = x”. Show that f is Riemann 
4 


integrable and find the integral | Polen. 
1 


Here we need the formulas 


yin a) Sve Mat Vent) 


Let n be a positive integer, and let P, = {29,21,...,2,} be the regular 
partition of [1, 4] into n intervals. Then 


Notice that the function f : [1,4] > | 
Therefore, on the interval |x;_1, xj], 


2 
m= flea) = (14 == ) ; 
n 


From this, we find that 


_ 3 6(2 —1 
-» mi(x; — Li-1) (1+ c Jy 
on nr 


i=1 


3 (n4m— 7 USES 2 


n 2n 


3 
= 5a lan” —15n +3), 
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14n? + 15n + 3). 


=a 


Moreover, ie 
Ch eile i = 
It follows that 
noo 


This proves that {P,,} is an Archimedes sequence of partitions for f. 
Therefore, f is Riemann integrable, and 


s 3 15 3 
ff #leyae = jim 01, Pa) = fim 5 (144 2 +S) = 20 


N—->Oo 


The following gives an ¢«—6 characterization of Riemann integrability in terms 


of Darboux sums. 


Theorem 4.8 Equivalent Definitions of Riemann Integrability 


Let f : [a,b] — R be a bounded function. Then the following two 
statements are equivalent. 


b pb 
(i) f : [a,b] + Ris Riemann integrable, in the sense that it i= ih ae 


(ii) For any € > 0, there exists ad > 0 so that if P = {x;}*_, is a partition 
of [a, b| with | P| < 6, then 


IGE IE) SUG, IP) 


By Lemma 4.6, f : [a,b] — R is Riemann integrable if and only if for 
every € > 0, there is a partition P satisfying U(f,P) — L(f,P) < ¢. The 
highly nontriviality of this theorem is the existence of a single partition satisfying 
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U(f, P) — L(f, P) < € is equivalent to the existence of a positive number 6 such 
that all partitions P with gaps less than 6 satisfy U(f, P) — L(f, P) <e. 


(ii) implies (i) follows trivially from Lemma 4.6. 


Now assume that (i) holds. Since f : [a,b] + R is bounded, there exists a 


positive number / such that 
|f(z)| <M for all x € [a, b]. 
Given ¢ > 0, Lemma 4.6 implies that there is a partition 
ey Heine ieee oy 


of [a, b] such that 
UG, by Lara) 

Take 

ee 

8sM- 

Then 6 > 0. If P = {2o,%1,..., 2} is a partition of [a,b] with |P| < 6, 
we want to show that 

k 


U(f, P) — L(f, P) = (Mj — m,) (a; — 1-1) <e. 


w=1 


m= inf f(z), M;= sup_ f(z). 


Uj-1 SUS 2; 2j—-1 S20; 


Let 


Fy = stl < 1 < k | ane a Ee [sere eel 


be the set that contains those indices i where the interval |7;_, x;] contains 
a partition point of Po, and let Fy = {1,2,...,k}\ Fy be the set of those 
indices that are not in EF}. 
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By definition, the point Zo can only be in [x9, x], and the point 7, can only 
be in [x,1, v,]. For any 1 < 7 < s — 1, %; can be in at most two different 
subintervals of P. Hence, /, contains at most 2s elements. 

Splitting the sum over 7 to a sum over F; and a sum over £2, we have 


U(f, P)-L(f, P) = ) > (Mi—m,) (2-2-1) + 9 (Mi—m,) (i — 2-1). 


16 By Kaw Op) 


First we estimate the sum over FE. Since 
—M<f(x)<M forall x € [a, 8], 
we find that for any 1 <2 <k, 
0< M;-—m; < 2M. 


Since x; — 1;_1 < |P| < 6, we have 


1€ By 1€ Fy 


Let P* be the common refinement of P and Pp obtained by taking the union 
of their partition points. By our definitions of £; and E»2, for each i in F2, 
[x;-1, X;| is also a partition interval in P*. Therefore, 


1€ Eg 
SU Fn) ea) 
The two estimates above imply that 


CUO AP EGE Oaks) 


which completes the proof that (i) implies (ii). 


A disadvantage of working with Darboux sums is we need to figure out the 
infimum and supremum of a function over the partition intervals. Let us turn to 


Riemann sums. 
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Lemma 4.9 


Let f : [a,b] + R bea bounded function, and let P = {x;}*_, be a partition 
of [a,b]. For every c > 0, there exist choices of intermediate points A and 
B for the partition P such that 


Wes eA) fie, OFF ei tee Nee, 


For! <%= ki letm, — int fiz) and i, — "sup fa) By 


Ui-1 LULU; wj_-1<a2<a; 


definitions of infimum and supremum, for each 1 < iz < k, there are points 
&; and 7; in [aj_-1, x;] such that 


is SG tip ae 


S 


i 
(b—a)’ 


Me < f(m) SM. 


—a) 


Multiply by (2; — x;_1) and sum over 7, we find that 


j=ll 


Let A = {€;}*_, and B = {n,}*_,. They are choices of intermediate points 
for the partition P. The two inequalities above give 


L(f,P) < RUf,P,A) < L(f,P) +6, 
ONG eye tS ee) Se) 


which are the desired results. 


The following gives an ¢ — 6 definition for Riemann integrability of a bounded 


function. 
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Theorem 4.10 Equivalent Definitions of Riemann Integrability 


Let f : [a,b] + R be a bounded function. Consider the following two 


definitions for f to be Riemann integrable. 


(i) [r= fs 


(ii) There is a number J such that for any <« > 0, there exists ad > 0 so 
that if P = {x,;}*_, is a partition of [a,b] with |P| < 6, A = {&}%, 


is a choice of intermediate points for P, then 


GER) ee 


These two statements are equivalent, and in case f is Riemann integrable, 
b pb b 
aa 
Ja_ a a 


Note that statement (ii) can be expressed as saying the limit of Riemann sums 


r= ii P.A 
Lee A) 


exists. 


Assume that (i) holds. Let 


rm [r= fs 


Given ¢ > 0, by Theorem 4.8, there exists a 6 > 0 such that if P = {x;}*_, 
is a partition of [a, b] with | P| < 6, then 


U(f, P) — L(f, P) <e. 
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If A = {€,}*_, is any choice of intermediate points for the partition P, 
EG) Le) SAG IAS WAS Ie) 
Since we also have 
TU GE 2S ESTO GIS), 


we find that 
Pee fete el SUG ee) <E. 


This proves that (i) implies (11). 
Conversely, assume that (ii) holds. By Lemma 4.6, to show that (i) holds, it 
suffices to prove that for any < > 0, there is a partition P of |a, b| so that 


U(f, P) — L(f, P) <e. 


Given ¢ > 0, (ii) implies there is a 6 > 0 such that if P = {zx;}%, isa 
partition of [a,b] with |P| < 6, A = {&;}*_, is a choice of intermediate 
points for the partition P, then 


IR(f,P, A) — | < 5. (4.3) 


Here J is the limit of Riemann sums implied by (ii). Let P = {x;}"_) bea 
regular partition into n intervals, where n is large enough so that 


_ 
es 
n 


By Lemma 4.9, there exist choices of intermediate points A and B for the 
partition P which satisfy 


UGP\ = BRAS GLP) Ss GR EN = = 


These imply that 


U(f, P) — L(f, P) < R(f,P,A) — R(f,P,B) + =. 
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By (4.3), 


This proves that 
OG, P LP) <eé 


which completes the proof that (ii) implies (1). 


As a consequence of Theorem 4.8 and Theorem 4.10, we have the following. 


Corollary 4.11 


Let f : [a,b] > R be a bounded function that is Riemann integrable, and 
let {P,,} be a sequence of partitions of [a, 6] such that 

lineata el 105 

n—->co 


Then 
b 
(a) / {= lim UG.) = lim ti fecles) 


(b) [ f= Jim R(f, Pn, An), where for each n € Z*, A,, is a choice of 


iePIEdIEIS points for the partition P,,. 


This corollary says that if we know apriori that f : [a,b] + Ris Riemann 
integrable, then we can evaluate the integral by a sequence of partitions whose 
gaps goes to 0, using either the Darboux upper sums, or the Darboux lower sums, 


or Riemann sums for any choice of intermediate points. 


b 
(ere i) f. Given « > 0, Theorem 4.8 and Theorem 4.10 imply that 


a 
there is ad > such that for any partition P with |P| < 6, and any choice of 
intermdiates points A for the partition P, 


ONG 9 cd) peae Sin aie age and eel fc Al oe. 
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Since lim |P,,| = 0, there is a positive integer N so that for alln > N, 
n> co 
|P,,| < 6. This implies that for alln > N, 


UG y= eee and | Aiea 
Since L(f, P,) < I < U(f, P,), we find that 
IU(f, Pa) -—I|<e and |L(f,P,)-I|<e foralln>N. 
These prove that 


fe Slim nCG7 lee linn 2 (iene — slime elena Ie 
Noo 


NCO NCO 


For every positive integer n, take P,, to be the regular partition of [a, b] into 
n intervals. This gives a sequence of partitions {P,,} with 


bes 
Tian 75, lin 
n—-0o n>0 86N 


For the choices of intermediate points A,,, one can take the left end point of 
each interval, or the right end point, or the midpoint. 


Example 4.13 


We are going to prove in Section 4.3 that a continuous function is 


integrable. The function f : [0,6] + R, f(x) = 6x — 2? is continuous. Use 


6 
Riemann sums to evaluate the integral | Wea. 
0 


Solution 
For a positive integer n, let P, = {x;}"_, be the regular partition of (0, 6] 


into n intervals. Then 
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Zit 


et-Ay—+ &) ),. where 


2 6 
_ 36(n? — 1) 


2 0 


ee eet one ») 


n 


Therefore, 


NCO 


[sea = im pres Ay) — ne 
0 
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Exercises 4.1 


Question 1 


Let f : [0,2] — R be the function f(x) = 4 — x”. Given a positive integer 
n, let P,, be the regular partition of [0,2] into n subintervals. 


(a) Compute L(f, P,,) and U(f, P,). 
(b) Show directly that lim (Ge = hie) — 0 


(c) Use part (b) to conclude that f is Riemann integrable and find the 
2 


integral i je Che 
0 


Question 2 


Given that the functon f : [0,4] ~ R, f(z) = x? — 2x + 3 is Riemann 


4 
integrable. Use Riemann sums to evaluate the integral | Fae. 
0 
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4.2 Properties of Riemann Integrals 


In this section, we derive some properties of the Riemann integrals. First we show 


that integral of a nonnegative function is nonnegative. 


Theorem 4.12 


R is a bounded function that is Riemann integrable, and 


Ga) for all x € [a, bj, 


Since f is Riemann integrable, 


n—-Cco 


[f= jm_tu. Po, 


where P,, is the regular partition of [a,b] into n intervals. Since f(x) > 0 
for all x € [a, ], we find that 


efi AO) for all n € Z*. 


[reo 


Linearity is always an important property. 


Therefore, 
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Theorem 4.13 Linearity of Integrals 


Let f : [a,b] > Rand g : [a,b] + R be bounded functions. If f and g are 
Riemann integrable, then for any constants a and 6, af + 6g : [a,b] > 


is also Riemann integrable, and 


forren=of +6 fig 


Here we use the fact that a function h : [a,b] — R is Riemann integrable 
if and only if the limit (ie as P, A) exists. Since f : [a,b] > R and 
—_ 


g: [a,b] + R are bounded, af + (g is also bounded. Since f : [a,b] > R 
and g : [a,b] + R are Riemann integrable, 


b b 
[ f= him FUP A), [ 9= jim, RP.) 


Notice that for any partition P = {x;}*_, of [a,b], and any choice of 
intermediate points A = {€;}*_, for the partition P, 


k 


R(af + Bg, P, A) = 55 (af(&) + B9(&)) (ei — 2-1) 
cl 
fA Orig, ie A) 
Limit laws imply that 
i =a li P,A li P,A 
pie leas + 8g,P,A)=a ne Ha yA) =e ee ey 


=afs+o fs 


This proves that af + Gg is Riemann integrable and 


forren=of +5 fg 


From the previous two theorems, we obtain a comparison theorem for integrals. 
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Theorem 4.14 Monotonicity 


Let f : [a,b] > Rand g : [a,b] > R be bounded functions. If f and g are 
Riemann integrable, and 


fin aa) for all x € [a, 6], 


[rz fio 


Define h : [a,b] — R to be the function h(x) = f(x) — g(x). Then 
h(x) > 0 for all x € [a,b]. By Theorem 4.13, h is Riemann integrable and 


[rope ye 


By Theorem 4.12, / h > 0. Hence, 


[rz fio 


We can apply the monotonicity theorem to obtain bounds for an integral from 


the lower bound and the upper bound of the function. 


Example 4.14 


Let f : [a,b] > R be a Riemann integrable funtion satisfying 


Te a) for all x € [a, b]. 


m(b—a) < p< M(b—a). 


a 


When an interval is partitioned into a finite collection of intervals, the integral 
over the whole interval is expected to equal to the sum of the intergrals over the 
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subintervals. It is enough for us to consider two subintervals. 


Theorem 4.15 Additivity 


Let f : [a,b] + R be a bounded function, and let c be a point in (a,b). 


(a) If f : [a,b] — R is Riemann integrable, then f : [a,c] — R and 


f : [c,b] + R are Riemann integrable. 


(b) If f : [a,c] > Rand f : [c,b] — R are Riemann integrable, then 
f : [a,b] + R is Riemann integrable. 


fr-fele 


We use Lemma 4.6. First we prove (a). Given ¢ > 0, since f : [a,b] > 


In either case, 


is Riemann integrable, there is a partition P of |a, b| such that 


Let P* be the partition of [a,b] that is obtained by taking the union of 
the partition points in P and Py = {a,c,b}. If P already contains c as 
a partition point, then P* = P. In any case, P* is a refinement of P. 
Therefore, 


OG aia Jes i) Gece. 


Consider P* as a refinement of Pp, let P, be the partition of [a,c] induced 
by P*, and let P, be the partition of [c, b] induced by P*. Then 


ia) = ier) Bee pete), UN Ie | = Gea) ia). 
These imply that 


CONG SS) Gi) UN, ey IBGs Jey) UG I ISG 1) ex oe 
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Since U(f, P,) — L(f, P,) > O and U(f, P2) — L(f, P2) > 0, we find that 


U(f,Pi)-—L(f,Pi)<e and U(f,P.) —L(f, Po) <e. 


By Lemma 4.6, we conclude that f : [a,c] > Rand f : [c,b] — R are 


Riemann integrable. 


Next, we prove (b). Given < > 0, since f : [a,c] > Rand f : [c,b] > R 


are Riemann integrable, there exists a partition P, of [a,c], and a partition 
Py, of [c, 6] such that 


U(F,Pi)—L(f,Pi) <5 and U(f, Ps) — L(f, Ps) < 


= 

5: 

Let P be the partition of [a,b] obtained by taking the union of the partition 
points in P; and P,. Then 


ie) = Da) or Gia) UF) Sas CNC) ae Cf peo): 
Therefore, 


Oi) Gi 2) a COG eG ei CCG E ey) Ga le) <E. 


This proves that f : [a,b] + R is Riemann integrable. 

Now we prove the last statement. For any positive integer n, let P; ,, be the 
regular partition of [a,c] into n intervals, and let P,,,, be the regular partition 
of [c, b] into n intervals. Then let P,, be the partition of [a,b] obtained by 
taking the union of the partition points in P,,, and P,,. For the Darboux 
upper sums, we have 


UG P,) = Dy, Pin) al U(f, Pape 


Taking the n — oo limits on both sides, we conclude that 


fr-fr+ ft 
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Extension of Definition of Integrals 


b 
The additivity allows us to extend the definition of the integral i f to the 


eo 
ae 


b Cc 
Then one can check that as long as two of the three integrals / es ‘ 1G 


case where a > b. We define 


If a > b, define 


b 
if f exist, the third one also exists, and we always have 
Cc 


fs-fr+ ft 


Using induction, we can extend the additivity theorem. 


Corollary 4.16 General Additivity Theorem 


Let f : [a,b] + R be a bounded function, and let Py = {ao, a1,...,a,} be 
a partition of [a,b]. Then f : [a,b] + R is Riemann integrable if and only 


if foreach 1 < i < k, f : [aj-1,a;] — R is Riemann integrable. In this 


case, 


[i terte= [9+ Pree fsa fs 
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Exercises 4.2 


Question 1 


Given that f : [2,7] > R is a function satisfying 


Se Sal for all x € [2, 7]. 


fe 
Find a lower bound and an upper bound for ii Glen eaes 
2 


Question 2 


Given that f : [a,b] + Rand g: [a,b] — R are bounded functions, P is a 
partition of [a,b], and c and d are two points in [a,b] with c < d. Prove the 
following. 


(a) pint (f+ 9)(@) > inf f(x) + int 9(@). 


c<a<d 


(b) sup (f+g)(z) < sup f(x) + sup g(z). 


c<a<d c<a<d c<a<d 
(CE aig) ete ig eta) 
(UG GP SUG, Py ui ge): 


Then use (c) and (d) to give a proof of the following statement: If f : 
[a,b] + Rand g: [a,b] > R are Riemann integrable, then f + g : [a,b] > 


R is also Riemann integrable, and 


fuso= fre fis 
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4.3 Functions that are Riemann Integrable 


In this section, we are going to derive Riemann integrability of a few classes of 
functions. The first class of functions that are of interest is the class of continuous 


functions. If f : [a,b] + R is a continuous function, then f(|a, b]) is sequentially 


compact. In particular, f({a,b]) is bounded. Hence, if f : [a,b] > Risa 


continuous function, it is bounded. The crucial property for a continuous function 
defined on a closed and bounded interval to be integrable is uniform continuity. 


Theorem 4.17 


Let f : [a,b] — R be a continuous function. Then f : [a,b] > 
Riemann integrable. 


Since f : [a,b] — R is a continuous function defined on a closed and 


bounded interval, it is uniformly continuous. Given « > 0, there exists 
6 > 0 such that for any u and v in [a, b] with Ju — v| < 4, 


€ 


f(a) = fe) < -—. 


Let P = {x;}*_) be a partition of [a, b] with |P| < 6. For any 1 <i <k, 


f : [:-1, 2;] + R is continuous. By extreme value theorem, there exists wu; 


and v; in [7;_1, 7;] such that 


m= inf f(x) = flu), M;= sup f(z) = f(u). 


Lji-1 5052; en eles 


Then 
lu; — v,| <4; - Uj-1 < ie < oO. 


Therefore, 
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This proves that f : [a,b] + R is Riemann integrable. 


It follows from this theorem that all the following classes of functions 
are integrable on a closed and bounded interval that is contained in their 
domains. 


Polynomials 

Rational Functions 
Exponential Functions 
Logarithmic Functions 


Trigonometric Functions 


Let us revisit the concept of area, which is our original motivation to define 
integrals. 


Remark 4.3 Area 


Let f : [a,b] — R be a continuous function such that f(x) > 0 for all 


x € |{a,b], and let R be the region bounded between the x-axis, the lines 


x =a and x = b, as well as the curve y = f(x). 
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y y 
A 


Figure 4.7: Darboux lower sum underestimates area while Darboux upper sum 


overestimates area. 


Given P a partition of [a,b], the Darboux lower sum L(f, P) is a sum of 

areas of rectangles that are inside R. The Darboux upper sum U(f, P) is a 

sum of areas of rectangles whose union contains R. Therefore, if R has a 

area A, L(f, P) is less than or equal to A, while U(f, P) is larger than or 
b 

equal to A. Since f is continuous, the Riemann integral J = / ji@jda 


exists. By definition, / is the unique number such that 
des UT) 


for all partitions P of [a,b]. Therefore, we define the area of R to be this 
number J. Namely, 


b 
Areaot R= | rica lee 


There are also other classes of functions that are Riemann integrable, which 
are useful. First, we relax the continuity condition slightly in the previous theorem. 
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Theorem 4.18 


Let f : [a,b] + R be a bounded function that is continuous on (a, b). Then 


f : [a,b] + R is Riemann integrable. 


Here we only assume f is continuous on (a,b). The function can take on any 


values on the boundary points a and b. 


Since f : [a,b] + Ris bounded, there is a positive constant / such that 


|f(z)| <M for all x € [a, }). 


, e b-a 
fe = 000) ae 
8M’ 3 


Then r > 0 anda+r < b—r. The function f : [a+7r,b-—r] > Ris 


Given < > 0, let 


continuous. By Theorem 4.17, f : [a+r,b—1r] — R is Riemann integrable. 
Therefore, there is a partition P, of [a + r,b — r] such that 


U(f, Pi) — LFA) < 5. 


Let P be the partition of [a, b] obtained by adding the points a and b to Py. 
Then 


UG, P= LP) = U(f, El L(f, i) 
sup f(x)— inf f(e)) 


hae. ax<r<a+r 


sup f(x) —_ inf r(e)) 


b—r<a<b b—rsas<b 


+4M 
ion 
Z 


This proves that f : [a,b R is Riemann integrable. 


As we can see in the proof above, the integral i f does not depend on the 
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function value at the end points. In fact, this is true for any finite number of points. 


Theorem 4.19 


Let f : [a,b] — R be a bounded function that is Riemann integrable. 


Assume that g : [a,b] > R is a function and S = {aj,d2,...,a,} is a 
finite subset of |a, b] such that 


for all x € [a, b] \ S. 


Then g : [a,b] + R is Riemann integrable, and 
b b 
fo-[s 


Let h : [a,b] > R be the function h(x) = g(x) — f(x). Then h(x) = 0 for 
x € [a,b] \ S. Since S is a finite set, h is bounded, and so there is a positive 


constant / such that |h(x)| < M for all x € [a,b]. Given a positive integer 
n, let P, = {X0,%1,..-, Xn} be the regular partition of |a, b] into n intervals. 
There are at most 2k of the intervals [x;_, 7;] that contains a point of S. In 
these intervals, 


—-M< inf A(z)< sup A(z) <M. 


— Hi-1 STS pene, 
If [x;_-1, x;| does not contain any points of S, then 


noe | (Ge Sip) alae) 0. 


Ljp-1 LLL; Lji-1 <a <x; 


These imply that 


U(h,P,)= >> sup A(x)(a;- 241) < 


a1 Uj-15 257; 


n 


(es eee 


| WRI SES 


| 
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Therefore, 


_2Mk(b — a) ROVE iie Nee UG a) 2Mk(b — a) 


n n 


Taking n — oo limits, we find that 


tool (Gi, 22) hea EI 1) 


nN— oo n—>co 


By the Archimedes-Riemann theorem, h : [a,b] +> Ris Riemann integrable 


b 
and i h = 0. Therefore, g = h + f is also Riemann integrable and 


fea [eefre[t 


Remark 4.4 


If f : (a,b) — R is a bounded function, we can extend the function to 
[a, b] and discuss its integrability. By Theorem 4.19, this is not affected by 
how we define the function at x = a and x = b. In case the extension is 


Riemann integrable, we still denote the integral by / i 


a 


Definition 4.10 Piecewise Continuous Functions 


We say that a function f : [a,b] + R is piecewise continuous if there is 


a partition Po = {ao,a1,...,a,%} of [a,b] such that foreach 1 <i < k, 


f : (ai-1, a;) — R is continuous. 


Using the general additivity theorem (Corollary 4.16) and Theorem 4.18, we 
obtain the following immediately. 


Theorem 4.20 


Let f : [a,b] + R be a function that is bounded and piecewise continuous. 


Then f : [a,b] + R is Riemann integrable. 
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Example 4.15 


The function f : [—1, 2] + R defined by 


if 125 20, 
i Or 2 


is piecewise continuous and bounded. Hence, f : [—1,2] — R is Riemann 


integrable. 


Figure 4.8: The piecewise continuous function defined in Example 4.15. 


A special class of function that is bounded and piecewise continuous is the 
class of step functions. 


Definition 4.11 Step Functions 


We say that f : [a,b] > R is a step function if there is a partition Pp = 


{ao,@1,..., Ax} of [a, 6] such that foreach 1 <i < k, f : (ai-1,a;) > R 


is a constant function. 


By previous theorem, a step function is Riemann integrable. In fact, it is easy 
to compute its integral. 
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Proposition 4.21 


Let Py = {ao, a1,..., @,} be a partition of [a,b], and let f : [a,b] 1 
step function such that for 1 <2 < k, 


2 i— 6,2 WHEN) sa, wo << U;. 


Then f : [a,b] + Ris Riemann integrable and 


b k 
i f= S> cilai a fia) 
a i=1 


Example 4.16 


Let f : [0,5] + R be the function defined as 


i, if0<2 <1, 
[b/t], ifl<2x<5. 


5 
Show that f is Riemann integrable and find i ne 
0 


Solution 
The function f is given explicitly by 


ihc: <i 
if l<2<5/4, 
if 5/4<a <5/3, 
if 5/3 <a <5/2, 
, if 5/2<2<5. 


This is a step function. Hence, it is integrable, and 


5 i . 5 5 89 
=i < ildbad se 2463 & = 4B x Sel X< a= =. 
[i ae de pea Ga ead ene 


The following theorem shows that monotonic functions are also Riemann 
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Figure 4.9: The function defined in Example 4.16. 


integrable. 


Theorem 4.22 


R is a monotonic function, then it is Riemann integrable. 


Without loss of generality, assume that f : [a,b] — R is an increasing 
function. If P = {z; ie is a partition of [a, b], then for any 1 <i < k, 


m= mi fie) = f(a); M;=_ inf f(z) = f(z). 


Li-1 SLL; Le-1 SLL; 


Therefore, 


n 


GI) Gree) = S° (f(a) =a i) ea) ae = they) 


j=l 


For each positive integer n, let P,, be the regular partition of [a,b] into n 
intervals. Then 


oe Z 


U(f, Pa) — Lf, Pa) = =) (f(@:) — fin) 
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This implies that 


fe (GE B= HG yy) — tn, UN) = he) 


n—0o n—00 n 


= 0. 


In other words, {P,,} is an Archimedes sequence of partitions for f. By the 


Archimedes-Riemann theorem, this proves that f is Riemann integrable. 


Example 4.17 


Let f : [0,1] — R be the function defined by f(0) = 1, and for each 
positive integer n, 


— ——.,, when 
ose 


One can verify that f : [0,1] — R is a decreasing function. Hence, it is 
Riemann integrable. However, f is not a piecewise continuous function, 


since it has discontinuities at infinitely many points. 


The Riemann integrability of a function implies the Riemann integrability of 
its absolute value. 


Theorem 4.23 


Let f : [a,b] + R be a bounded function. If f : [a,b] > Ris Riemann 
integrable, then the function || : [a,b] + R is Riemann integrable. 


We will first prove the following: For any c and d in [a,b] with c < d, 


sup |f(z)|— inf |f(x)|< sup f(z)— inf f(z). (44) 


c<a<d c<a<d c<a<d c<a<d 


There are two sequences of points {u,,} and {v,,} in [c, d] such that 


c<a<d 


Jim |f(un)| = int |f(@)L, Tim | f(r) | = sup MN 
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Since u,, and v,, are points in {c, d], we find that 
[F(Yn)| — [F(n)| SF) — Fun) S 


Passing to the n — oo limit, we obtain (4.4). 


Now, given < > 0, since f : [a,b] — R is Riemann integrable, there is a 
partition P = {x;}*_, of [a,b] such that 


UG 1) Ie re: 
But then 
UF pe) ae) 


a sop (A@)I= iat IPC) (es — 9) 


Ljp-1 SUL; ©j-1 SUS; 


»( sup fle)~,, int, fl@)) (@ 2) 


Gi Sais Lj LULU; 


=U(f,P)— L(f, P) <e. 


This prove that | f| : [a,b] + Ris Riemann integrable. 


y =| fo) 


Figure 4.10: A function y = f(x) and its absolute value y = | f(x)]. 
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Remark 4.5 


The converse of Theorem 4.23 is not true. Namely, if a function f : [a,b] > 


R is bounded, |f| : [a,b] — R is Riemann integrable does not imply that 


f : [a,b] + Ris Riemann integrable. For a counter example, consider the 
function f : [0,1] + R defined as 


if x is rational, 


—1, if x is irrational. 


One can prove that f : [0,1] — R is not integrable, exactly the same way 


as in Example 4.11. On the other hand, since | f| : [0,1] — R is a constant 


function, it is Riemann integrable. 


The following theorem says that the product of Riemann integrable functions 
is Riemann integrable. 
Theorem 4.24 


Let f : [a,b] — R and g : {a,b] — R be bounded functions. If f : 
[a,b] + Rand g : [a,b] — R are Riemann integrable, then the function 


(fg) : [a,b] + Ris also Riemann integrable. 


We will apply Lemma 4.6 to prove the Riemann integrability of the function 
h = (fg) : [a,b] > R. Since f : [a,b] > Rand g : [a,b] > R are bounded 
functions, there is a positive number / so that 


lf(z)| <M and |g(x)| << M for all x € [a, b]. 


We claim that for any c and d in [a, b] with c < d, 


sup h(x) — int h(x) 


c<a<d 


(4.5) 
<M (sup fle) int f(0) + sup g(x) — int o(e)) 


c<a<d Cadi c<u<d 
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There are two sequences of points {w,,} and {v,,} in [c, d] such that 


ian (Ge = wali neal lim A(v,) = sup A(z). 


n—0o c<a<d n—0o aerial 


Notice that 


[h(On) — h(tn)| = |gn) (Fn) — F(Un)) + F(tin) (G(r) — 9(un))| 
S |9@n) NF Cn) — Fun)| + Fun )I19 (Un) = 9 (Un) | 


Since u,, and v,, are in [c, d], we find that 


|f(Un) — Flun)| < sup f(x)— inf f(z), 


c<a<d c<a<d 
= < = : 
lgn) — 9(un)| S sup g(t) — inf g(x) 


Therefore, 
|h(Un) — h(un)| 


< ai | 
<M ( suv ey fa Ea oe) int 9 ) 
Passing to the n — oo limit gives (4.5). 

Now given € > 0, there are partitions P, and P, of [a, b] such that 


es 
2M’ 


2 
UG es) (ge) Va 


CG a SAG ay l< 


Let P* = {x0,21,...,2%,} be acommon refinement of P, and P,. Then 


ann 
2M’ 


& 
P*) — Lig, P* =. 


iG) =a) = 
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It follows that 


sup A(x)— _ inf h(c)) (x; — ©_1) 


Lj-1 SEL; %j-1 S859; 


(_ sup f@) =, int, fe) @ 204) 


Bi ae Ug oat Lj-1 LLL; 


(sup o(e) =| inf, gle) (© —004) 


Lj-1 SUL; %j-1 SBS %; 


= M(U(f, P*) — L(f, P*) + U(g, P*) — L(g, P*)) 
€ ‘ 
(oy am 2 


This proves that (fg) : [a,b] + Ris Riemann integrable. 
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Exercises 4.3 


Question 1 


Given that f : [—1, 1] > Ris the function defined by 
4 
sin (=) : Via <3 0) 
£ 
0, ee 
Explain why f : [—1, 1] + R is Riemann integrable. 


Question 2 


Let f : [a,b] > R be a bounded function. If f : [a,b] > Ris Riemann 
integrable, show that 


[fede] < [isterlae 


Question 3 


Let f : [0,6] + R be the function defined as 
=>) if0<a#<1, 
eae ibe eee Sais 


6 
Show that f is Riemann integrable and find i ik 
0 


Question 4 


Let f : R > R be the function defined as 


F(a) = (e- |2J)*. 


Explain why the function f is Riemann integrable on any closed and 
bounded interval [a, 0). 
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Question 5 


Let f : [a,b] — Rand g : [a,b] + R be bounded functions. Define the 
function h : [a,b] > R by 


h(a) = max{ f(x), 9(@)}. 


(a) Show that 
oo PLS 


i 2 


(b) If f : [a,b] + Rand g: [a,b] > R are Riemann integrable, show that 


h : [a,b] + Ris also Riemann integrable. 


Question 6 [Cauchy Schwarz Inequality] 


Let f : [a,b] > R and g : [a,b] — R be bounded functions that are 
Riemann integrable. Prove that 


(/ "Fadalayde), <(f “J(a)%dr) (/ “gloVr) | 
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4.4 The Fundamental Theorem of Calculus 


In this section, we prove the fundamental theorem of calculus, which gives a 


relation between integration and differentiation. It also provides a useful method 


to compute integrals of certain functions. We first prove a few results about 


integrals. 
Given that a function f : [a,b] — 


R is bounded and Riemann integrable on 


[a, b], it is Riemann integrable on any interval [c, d] that is contained in the interval 


[a, b]. Thus, we can define a new function F': [a, b] + R by 


F(z) = / * Fea 


By definition, /'(a) = 0. For any c and d in |a, b], one can check that 


Fa=Fe= [ seodu— free cs [ feotu 


The followng theorem says that F’ : [a, b] + R is a continuous function. 


Theorem 4.25 


Let f : [a,b] + R be a bounded function that is Riemann integrable, and 
let F' : [a,b] + R be the function defined by 


F(a) = [ f(u)du. 


Then F': |a,b| + R is a Lipschitz function, and hence it is continuous. 


It is sufficient to prove that F’ : [a,b] — R is Lipschitz. The continuity 


follows. Since f : [a,b] — R is bounded, there is a positive constant 


such that 
[ee 


for all x € |a, 0). 
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For any x, and £2 in [a, b| with 7, < x, we have 


eG) ie iS / ~ Honea, 


Therefore, 


< [ ” | f(u)ldu 


Ty 


= M (a2 — 21) — M|x2 — 24\. 


This proves that F’ : R is a Lipschitz function wth Lipschitz 


constant VM. 


The next is a mean value theorem for integrals. 


Theorem 4.26 Mean Value Theorem for Integrals 


Let f : [a,b] + R be a continuous function. Then there exists c in [a, }] 
such that 


i! b 
| t@x=s. 


This theorem is known as the mean value theorem since 


b 
5 : _ | f(x)dx 


can be interpreted as the average of the values of f over the interval {a, b]. 


Since f : [a,b] — R is a continuous function, the extreme value theorem 
says that there are points wu and v in [a, b] such that 


DS eS Ge) for all x € [a, }]. 


This implies that 
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Therefore, the number 


b 
v= | ileaene 


satisfies 
OD) (0) 


By intermediate value theorem, there is a point c in [a,b] such that f(c) = 


w. This gives : 
1 
[tear = s00. 


In fact, one can argue that the number c can be chosen to be in (a, b). 


Example 4.18 


Let f : [a,b] + R be a continuous function. If f(a) > m for all x € |a, | 
and 


[ fear =mo-0), 


prove that 
yee) = a0 for all x € [a, 0). 


Solution 
Let g : [a,b] > R be the function g(a) = f(x) — m. Then g: [a,b] > 1 


a continuous function and g(x) > 0 for all x € [a,b]. Moreover, 


io = [ seo — [mae =) 


We want to show that g(x) = 0 for all « € [a,b]. Suppose to the contrary 
that there is a point 2 in [a, b] such that g(xo) # 0. Then g(x) > 0. Since 
g is continuous, there exists ad > 0 such that for all x € (ap — 6,29 +0) 
(a,b), 


Chapter 4. Integrating Functions of a Single Variable 305 


om 
Without loss of generality, assume that 6 < aon Then either 77 —6 >a 


or 29 + 6 < b. In any case, (xp — 6, % + 6) A (a,b) = (c,d) is an interval 
of length at least 0. But then 


io = [ syae + [oto + [saver 


> 0x (e—a) + (d— 2 40x ~<a) 


ae co 


Z 


which is a contradiction. Therefore, we must have g(x) = 0 for all x € 
[a, b. 


Remark 4.6 


In the mean value theorem for integrals, we can strengthen the theorem to 
have the point c being a point in the open interval (a, b). In the proof, we 


b 
have shown that for w = i} i (wer, 


f(u)<w< f(v). 


Here f(u) is the minimum value of f : [a,b] — R, and f(v) is the 
maximum value. By Example 4.18, if w = f(u), then f is a constant. 
In this case, we can take c to be any point in (a,b). If w = f(v), the same 
reasoning as in Example 4.18 also shows that f is a constant, and so c also 
can be any point in (a,b). If w # f(u) and w F f(v), then c is a point 
strictly between wu and v, and thus it is strictly between a and b. 


Now we turn to the fundamental theorem of calculus. Consider the case that an 
object is moving with speed v(t) at time t. To find s(t), the distance travelled up to 
time t, we can partition the time interval [0, t] into a finite number of subintervals 
(0, ti], [t1, ta],..., [th-1, te], where t, = t. For each time interval [t;_1, t;], where 
1<i<k, take a point t? € [t;_1,t,], and approximate the average speed over the 
time interval |t;_1, t;] by the speed at time t;, v(t). Then the distance travelled up 
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to time ¢ is approximately 


S\ u(tf) (ts — ti-1). 


i=1 


We recognize that this is a Riemann sum of the speed function u(t). The distance 
travelled s(t) should be calculated as the limit where the gap of the partition goes 
to zero. In other words, 


which means that differentiation and integration are inverse processes of each 
other. The fundamental theorem of calculus gives a rigorous setting for this. 


Theorem 4.27 Fundamental Theorem of Calculus I 


Let f : [a,b] + R be a bounded function that is Riemann integrable, and 
let F' : [a,b] + R be the function defined by 


F(z) = / ane 


If xo is a point in (a,b), and f is continuous at x, then F’ is differentiable 


at % and 


F"(xo) = f(£o): 


Proof of Fundamental Theorem of Calculus I 
We need to show that the limit 


re F (ao +h) — F(20) 
h—0 h 


exists and is equal to f(x). Given € > 0, since f is continuous at xo, there 
is ad > 0 such that (ro — 6,% + 0) C (a,b) and 


IF(2) — f(20)| < 5 for all x € (ap —6,29 +5). (4.6) 
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For h € (—d, 4), 


F (20 + h) = F(z) — f(xo)h 


Eq. (4.6) implies that 
|F (to + h) — F(ao) — F( 
Hence, if h € (—0d,6) \ {0}, 


F (ao + h) — F(a) 


a a f (xo) 


This proves that 


In fact, the point x» can be a or b if we consider one-sided derivatives. 


Example 4.19 


Consider the piecewise continuous function f : [0,2] > R given by 


if0<a2<1, 
ifl<2<2, 


i —o. 


if0<2x<1, 


= 38 ifl<=e< 2 
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The function Ff’ : [0,2] — R is continuous. For x € (0,1), F is 
differentiable and F’(x) = —1 = f(x). For x € (1,2), F is differentiable 
and F’(x) = 2. However, F is not differentiable at x = 1 since 


fix) F(x) 


Figure 4.11: The function f : [0,2] > Rand F : [0,2] — R in Example 4.19. 


Example 4.20 


Evaluate the following derivatives. 
d xz 
(a) al sin(u”)du 
d 1 
(b) =i sin(u?)du 
2 


(c) a sin(u*)du 
Shee 


Solution 


The function f : R > R, f(x) = sin(zx”) is continuous. Hence, it is 
Riemann integrable over any closed and bounded intervals. Let 


F(z) = i a i, See ie 
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By fundamental theorem of calculus I, F’(x) 


(a) =f sin(u?)du 


oral in(u?)d 
ae oe U 


a2 


d Bers 
(c) aa / sin(u~)du 
= 2x sin(x*) — sin(x?). 


Now we turn to the second fundamental theorem of calculus, which provides 


a mean for calculating integrals of continuous functions. 


Theorem 4.28 Fundamental Theorem of Calculus II 


Let F’ : [a,b] — R be a continuous function, and let f : [a,b] — 


bounded function that is continuous on (a, b). If 


for all x € (a,b), 


F is called an antiderivative of f. Hence, the fundamental theorem of calculus II 


states that if the function f : (a,b) — R is continuous and it has an antiderivative 


F(a) which can be extended to a continuous function F’ : [a,b] + R, then 


/ f(x)dx = [F(a)]? = F() — F(a). 


We will present two proofs of the fundamental theorem of calculus II. The first 
one uses fundamental theorem of calculus I. 
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First Proof of Fundamental Theorem of Calculus II 


Since f : [a,b] + Ris a bounded function that is continuous on (a, b), it is 


integrable over any subinterval of [a,b]. Let G : [a,b] + R be the function 
defined by 


Ga) =f fludu 


By default, G(a) = 0. By Theorem 4.25, G is continuous on [a,b]. By 
fundamental theorem of calculus I, 


for all x € (a,b). 


Hence, F' : [a,b] + Rand G : [a,b] — R are continuous functions 
satisfying 
GF) for all x € (a,b). 


By Theorem 3.14, there is a constant C’ such that 
G(x) = F(x) +C. 


Since G(a) = 0, we find that C = —F'(a). Therefore, 


| fear = G0) = FW) - Flo). 


In different textbooks, the ordering of the two fundamental theorem of calculus 
might be different. One can use one to deduce the other. This is why a proof of 
the fundamental theorem of calculus II without using the fundamental theorem of 
calculus I is of interest. 
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Second Proof of Fundamental Theorem of Calculus II 


Here we use the Lagrange mean value theorem. Since f : [a,b] > R is 
a bounded function that is continuous on (a,b), it is integrable. Now if 
P = {2;}*_, is a partition of [a,b], for each 1 < i < k, the mean value 
theorem implies that there is a €; € (x;_1,7;) such that 


Ee) oP as) — P(E CEs at ea (Ge lia 
Summing over 7 gives 
LOSI G Ds (F(a:) — F(@-1)) 
where A = {€,}*_,. Since 
L(f,P) < RU, P,A) < Uf, P), 


we find that 


Notice that this is true for any partition P of [a,b]. By definitions of the 
lower integral and the upper integral, we find that 


[i Sea) a) (ass is 


Since f : [a,b] + Ris Riemann integrable, the lower integral and the upper 
integral are the same. Thus, 


fs i fi F(b) - F(a). 


We can relax the conditions in the fundamental theorem of calculus II to let f 


to be a piecewise continuous function. 
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Corollary 4.29 Generalized Fundamental Theorem of Calculus II 


Let S = {ao,a1,...,a,} be a finite subset of [a, b] that contains a and b, 


and let f : [a,b] + R be a bounded function that is continuous on [a, 6] \ S. 


If F': [a,b] + R is a continuous function, differentiable on [a, b] \ S, and 


for all x € [a,b] \ S, 


We can assume that 


Uy = Oy <7 e — . 


Since f : [a,b] — R is bounded and piecewise continuous, it is Riemann 
integrable. Moreover, by the generalized additivity theorem, we have 


[ fou 2 >| Henge: 


Applying the fundamental theorem of calculus II to each of the integrals 


f(x)dzx, we find that 


ay—-1 


i fle)de = (F(a) = Faia) = FQ) = Fa). 


This completes the proof. Note that it is crucial here that F’ is continuous 
on [a, b. 


As is well known, the fundamental theorem of calculus provides a practical 
method for computing integrals of functions that have antiderivatives. 
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Example 4.21 


Compute the integral of the piecewise continuous function f : [—1, 2] > | 


if S12 <0, 
if Oa = 2 


that is defined in Example 4.15. 


Solution 
Using additivity, 


ke = Lee +f Nee: 


Using fundamental theorem of calculus II, 


sear =f (2-2)r = fae - a =0-( 


2 2 A 2 
[ teow | ee IF 
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Remark 4.7 Alternative Proof of Mean Value Theorem for Integrals 


Using the fundamental theorem of calculus, we can give an alternative proof 
of the mean value theorem for integrals as follows. Since the function f : 


[a, b] + R is continuous, the function F’ : [a, b] + R defined by 


F(z) = / “faaan 


is continuous on |a, b|, differentiable on (a,b), and F’(a) = f(a) for all 
1b 


x € (a,b). By Lagrange mean value theorem, there is a c € (a,b) such that 


ae is _ F()- Fla) ayy 
[| t@a- Sa - Fo = 00. 


Finally, we can prove the existence and uniqueness theorem mentioned in 
Chapter 3, Theorem 3.21. 


Theorem 4.30 Existence and Uniqueness Theorem 


Let (a,b) be an open interval that contains the point x9, and let yo be any 


real number. Given that f : (a,b) — R is a continuous function, there 


exists a unique differentiable function F’ : (a,b) — R such that 


f(x) for all x € (a,b), Ec) — Ue 


As we mentioned before, the uniqueness follows from the identity criterion. 
For the existence, notice that f is continuous on any closed and bounded 
interval that is contained in (a,b). Hence, we can define the function F' : 
(a,b) > R by 


F(x) = / “Fileoylin eit 


Then F'(xo) = yo by default. By fundamental theorem of calculus, F’(x) = 
f(x) for all x € (a, 5). 


Let us look at some other examples how integrals can be applied. 
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Example 4.22 


Find the limit 


Sn ey ead 
dm ee (=) : 


Solution 
eae (=) 
— y sin { — 
n n 

k=1 


k 
as a Riemann sum. For 1 < k < n, let & = Ly These are equally 


We try to identify 


spaced points in the interval (0, 7]. This motivates us to define the function 


f : [0,7] — R, f(x) = sinz. Since f is a continuous function, it is 
Riemann integrable. Let P,, be the regular partition of [0, 7] into n intervals. 
Then with A,, = {&}7_,, we have 


T 
ER Gisele en) -Yan(e =) = 


Since f is Riemann integrable, 


lim Hf, Ap) -[ qe 


n—->co 


By fundamental theorem of calculus, 
| jar — | sin zdx = [—cosz], = 2. 
0 0 
Therefore, 


= lm RP. A.) — 


T n—-00 


Chapter 4. Integrating Functions of a Single Variable 316 


Exercises 4.4 


Question 1 


Evaluate the following derivatives. 


a ("72 
@ = [eta 


b ei (u?)d 
Oe ee 


ge 
(c) =| V2+sinu du 


Question 2 


Let f : [2,6] — R be the function defined by 


te Oe ei) 


c= =, i il ae << O. 
z 


Find a continuous function F’ : [—2,6] — R such that F is differentiable 
on (—2,6), F'(0) = 0, and 


for all « € (—2, 6). 


Question 3 


Find the limit 


Question 4 


Find the limit 
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4.5 Integration by Substitution and Integration by Parts 


In this section, we prove the integration by substitution formula and integration 
by parts formula. We will only deal with the case where the function that we are 
integrating is continuous in the interior of the integration interval. For general case 


where the function is piecewise continuous, one can apply the additivity theorem. 


4.5.1 Integration by Substitution 


Theorem 4.31 Integration by Substitution 


Let g : [a,b] > R be a function that satisfies the following conditions: 
(i) g is continuous and one-to-one on |a, }]; 
(ii) g is continuously differentiable on (a, b); 

(iii) g’(a) is bounded on (a, b). 


Then g maps the interval [a, b] onto a closed and bounded interval [c, d] with 
end points g(a) and g(b). If f : [c,d] + Risa function that is bounded and 


continuous on (c, d), then the function h : [a,b] > R, 


is Riemann integrable and 


[rear =f Hlole)o@ae = [ fulds. (4) 


This is equivalent to 


[ stot i. [ tow ele 


The function g : [a,b] + R that satisfies all the three given conditions defines 


a smooth change of variables u = g(x) from x to wu, in the sense that g is 


continuously differentiable on (a, b). 
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Since g is one-to-one, we have g((a,b)) C (c,d). Therefore, the function 
h: [a,b] > R, h(x) = f(g(x))g'(x) is continuous and bounded on (a, b), 
and hence, it is Riemann integrable. For any x € [a, }], let 


Then H;(a) = H2(a) = 0. By fundamental theorem of calculus, H, and 
Hy are differentiable on (a,b), and for any x € (a,b), 


Hy(x) = h(x) = f(g(@))9'(@), A(x) = f(g(a))9'(@). 


Since H)(x) = H3(x) for all x € (a,b), and H,(a) = H2(a), we conclude 
that H, (2) = H>(x) for all x € [a,b]. Namely, 


b (0) 
[ Howmpatae =f sodu 


From this, we see that integration by substitution is just the inverse of the 
chain rule for differentiation. To prove the equivalence of (4.7) and (4.8), 
we consider two cases. 

Case I: g is strictly increasing on [a, 0]. 

In this case, g'(x) > 0, and c = g(a), d = g(b). So (4.7) is equivalent to 
(4.8). 

Case II: g is strictly decreasing. 

In this case, g/(x) < 0, g(a) = dand g(b) = c. Therefore, 


[ tolo)lg@)iae = - fF flole))g @)ae 


[ f(u)du = [ fenau = mor 


Thus, (4.7) and (4.8) are equivalent. 


Chapter 4. Integrating Functions of a Single Variable 319 


If we impose the condition that f is continuous at the boundary points c and d, 
the condition that g is one-to-one can be removed. The points g(a) and g(b) might 
not be the boundary points of the interval J = g(|a, b]), but the proof still holds. 


Theorem 4.32 General Integration by Substitution 


Let g : [a,b] > R be a function that satisfies the following conditions: 
(i) g is continuous on {a, b]; 
(ii) g is continuously differentiable on (a, b); 


(iti) g'(x) is bounded on (a, b). 


Then g maps [a, b] to a closed and bounded interval J. If f : J > | 


continuous function, then the function h : [a,b] > R, 


is Riemann integrable and 


[ he)de = | “F(g(2))9'(e)dx = fi i f(u)du. 


Example 4.23 


3 
Evaluate the integral i £V16+ 22dz. 
= 


Solution 
Let f(x) = x and g(x) = 16 + 27. The function g is continuously 
differentiable, with g/(x) = 2x, and it maps the interval [—2,3] onto 
the interval [16,25]. However, it is not one-to-one. The function f is 
continuous on [16, 25], so we can apply the integration by substitution. In 
practice, we will do substitution by letting u = 16 + 2”, and find that 


du _ 


— = 22. 
dx i 
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This implies that we can replace rdx by du/2. When « = —2, u = 20; 
when x = 3, u = 25. Thus, 


3 i ie elo p0/ 20 
/ rV 16+ 22dxr = a Judu = Ge ————— 
—2 20 


3 


20 


Students are invited to split the integral into a sum of two integrals, one 
over the interval [—2, 0], and one over the interval [0, 3]. The function g(x) 
is one-to-one on each of these two intervals. Check that the same answer is 
obtained. 


As we mentioned before, if the change of variables is given by a one-to-one 
function u = g(x), the function f does not need to be continuous at the boundary 
points. Using addivitivity theorem, Theorem 4.31 still holds when f is a bounded 


piecewise continuous function. 


Example 4.24 


Let a be a positive number, and let f : [0, a] + R be a piecewise continuous 
function that is bounded. Show that 


[ toe = [ #0 — x)dzx. 


Solution 
We consider the change of variables u = g(x) = a — x. This is a strictly 
monotonic function with g'(x) = —1. Therefore, du = —dx. When x = 0, 


wu = a; when x = a, u = 0. Hence, 


[ tora x [ Fc “any = [ te ae 
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Example 4.25 


Let a be a positive number, and let f : [—a,a] — R be a piecewise 


continuous function that is bounded. 


(a) If f is an even function, show that 
eee — 2 | cn) Ghee 
—a 0 


(b) If f is an odd function, show that 


: eda), 


(0) 


Solution 
Notice that 


a 


sie (eae — 7 f(x)dx + [ fev 


—a 


0 

For the integral f(x)dx, we consider the change of variables u = 
—x. This is a strictly monotonic function with g/(z) = —1. 
Therefore, du = —dx. When x = —a, u = a; when x = 0, u = 0. 


Hence, 


aye = [ s-o-aw = [ #-oae. 


(a) When f is an even function, f(—x) = f(x) for all « € [0,q). 
Therefore, 


[ foyde= f slayae+ f flayae=2 f s(e)ae 


(b) When f is an odd function, f(—x) = —f(x) for all x € [0,a]. 
Therefore, 


Rio. =- [ toa + [ tae eR 
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y 
—a 0 a 2 
Figure 4.12: An even function. 
ye 
a 
x 
0 


Figure 4.13: An odd function. 


Example 4.26 Area of a Circle 
Find the area of a circle of radius r. 


ay 


ait 
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Solution 
A circle of radius r with center at the origin has equation x? + y? = r?. 
By symmetry, it is enough for us to find the area in the first quadrant, and 
then multiply by 4. The sector in the first quadrant is bounded by the curve 
y = Vr? — 2, the lines x = 0, x = r, and the x-axis. Hence, the area of a 
circle of radius r is 


A= af Vr2 — v2dax. 
0 


Making a change of variables x = r sin 0, we find that 


ue =rcos6. 


do 
When x = 0, 6 = 0; when x = r, 6 = 7/2. Therefore, 


Aza” Vr2 —r2sin? 6 r cos 6 dé 
0 


= 4r? ye cos’ 6 dé. 
0 


Using the formula 


1 20 
cos” @ = a 


we have 


A= oe (1 + cos 20) dé 
0 


sin =| 2 
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4.5.2 Integration by Parts 


Theorem 4.33 Integration by Parts 


Let f : [a,b] > Rand g: [a,b] — R be functions that satisfy the following 


conditions: 

(i) f and g are continuous on |a, }]; 

(ii) f and g are continuously differentiable on (a, b); 
(iii) f’(x) and g/(x) are bounded on (a, b). 


Then fg’ and gf’ are Riemann integrable on [a, b|, and 


/ f(a)g'(a)de = f(g(0) — f(a)9(a) — / HEE 


Since f and g are continuous on |a, b], they are bounded. Since f’(a) and 
g' (x) are conitnuous and bounded on (a, b), fg’ and f’g are continuous and 
bounded on (a, b). Therefore, fg’ and gf’ are Riemann integrable on [a, }]. 
By product rule, for any x € (a,b), 


(f9)'(x) = f(x) g'(a) + g(a) f(x). 


So (fg)’ is also bounded and continuous on (a,b), and hence Riemann 
integrable on [a,b]. Since fg is also continuous on [a,b], we can apply 
fundamental theorem of calculus, which gives 


i Golem =n =Car 


Therefore, 


[reovees f oestera 


This proves the integration by parts formula. 
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In a nutshell, the integration by parts formula is just the inverse of the product 
rule of differentiation. But it is a very useful integration technique. 


Integration by Parts 


The integration by parts formula is often expressed as 


[udv=wo— f odu. 


In practice, we identify which part should be wu and which part should be 
dv. The function v is defined up to a constant. One can verify directly that 
if v is replaced by v + C’,, where C' is a constant, the right hand side of the 
formula is not changed. Hence, we can choose a v that is most convenient. 


Example 4.27 


Let n be a positive integer. Evaluate the integral 


When xz = 1, u = 0; when z = e, u = 1. Therefore, 


1 ae 
[Ptar= fo utu= [5] mie 
| 


If n > 2, we use integration by parts. Let 


Then 


m—-1 gr! 


Both of u(x) and v(x) are continuously differentiable functions on (0, 00). 
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Therefore, 


Example 4.28 


Let J be an open interval that contains the point x9, and let f : J —~ R 
be a continuous function. Given a positive integer n, define the function 
F:I—4Rby 


1 x 

F(z)=— | («—-t)"f(t)dt. 
(I. 

Prove that F’ is (n + 1) times continuously differentiable, 


F(a) = F'(ao) =... = F™ (ao) = 0, 


HCO Ge) = 3a) for all x € I. 


Solution 
Define the function g : R—- Rb 


y 
4@)= i “f(bdt. 


Then g(xo) = 0, and by fundamental theorem of calculus, 
Ge) for all x € I. 


Now we prove the statement by induction on n. When n = 1, 


Ce [ @-pswee 


20) 
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By definition, F'(a9) = 0. For a fixed x, using integration by parts with 
u(t) = a2 —tandv’(t) = f(t), we find that 


[(@-noo] + " g(t)at = i * g(t)at 


t=x0 x0 x0 


Notice that g(t) is continuously differentiable, and hence it is continuous. 
By fundamental theorem of calculus, 


Ae Varia) for all x € I. 
Therefore, F’(x9) = g(Xo) = 0, and 
Ge nee) an for all x € I. 


This proves that F(a) is twice continuously differentiable. Since we have 
also shown that F'(%) = F’(xo) = 0, and F(x) = f(a) for all x € I. the 
statement is true when n = 1. 

Assume that we have proved the statement when n = k — 1, where k > 2. 
When n = k, 


Oe af — 1) f(t)at. 


For a fixed x, using integration by parts with u(t) = (2 — t)* and u'(t) = 
f(t), we find that 


tam t <5 fo — t)*"g(t)dt 


xO 


=a (a — t)*-*9(t)dt. 


By inductive hypothesis, the function F(x) satisfies 


F(a) = F'(ao) = +++ = F® (ap) = 0, 
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and 
F®)(¢) = g(x) for all x € I. 


The latter implies that F“) (ay) = g(xo) = 0, and F(x) is (k + 1) times 
differentiable, with 


POM (2) = g(a) = f(2) 


a continuous function. Therefore, when n = k+1, the statement also holds. 


By principle of mathematical induction, the statement is true for all positive 


integers n. 
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Exercises 4.5 


Question 2 


Let f : [a,b] + R be a bounded function that is Riemann integrable. Show 
that for any real number c, 


b b+e 
i Hal NLD f(a —c)dz. 


+e 


Question 2 


Explain why 


1 1 
/ (x + 1)e" de = 2 | eda. 
= 0 


Question 3 


Let a be a positive number. Assume that the functions f : [0,a] > R and 
g : [0, a] + R are bounded and piecewise continuous, prove that 


il * fla)g(a—2)dr = / * fla —2)g(x)de. 


Question 4 


Let m and n be nonnegative integers. Show that 


: m! n! 
m1 — 2)"dr = ; 
ie (1 — x)"dx Cera 
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Question 5 


Let f : [a,b] + R be a continuous and strictly increasing function which 
maps the interval [a, b] bijectively onto the interval [c, d], where c = f(a), 
and d = f(b). Denote by g : [c,d] — R the inverse function of f. Notice 
that f : [a,b] > Rand g : [c,d] — R are Riemann integrable. This 
question is regarding the proof of the formula 


b d 
[ tear = 6F0) - asa) — fF g(e)ae. (4.9) 
(a) Ifa > 0 and c > 0, draw a figure to illustrate the formula. 


(b) If f is continuously differentiable on (a,b), use integration by 
substitution with u = g(x) to prove the formula (4.9). 


(c) Let P, = {a;}'_ be the regular partition of the interval [a,b] into n 
intervals. For 0 <i < n, let y, = f(a;). Then pe — 11 ey eased 
partition of [c, d]. 


(i) Show that 


oD Poy ei): do gyi) (vi — y-1) = bf (b) — af(a). 


(ii) Show that lim |P,| = 0 and lim |P,| = 0. You might want to 
Noo Noo 
use uniform continuity. 


(iii) Use part (1) and part (11) to prove the formula (4.9). 
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4.6 Improper Integrals 


In this section, we want to discuss Riemann integrals for functions f : J — R 


defined on an interval J, where either J is not bounded, or f is not bounded on J, 
or both. 


Definition 4.12 Improper Integral 


Let J be an interval and let f : J — R be a function defined on J. An 


integral of the form 


fi 


is an improper integral if either f is not bounded on J, or J is an unbounded 


interval. 


This is not a rigorous definition. We will only be interested in the case where 
we can make sense of | qt: 


I 
As an example, Theorem 4.30 says that there exists a differentiable function 


g: (—1,1) - R satifying 


1 
‘(c) = ———, 0) = 0, 
W@)=p— 0 
It is given by 
* du 
2) = ———— du. 
g(x) / = 
1 
Notice that the function f(u) = aan is bounded and continuous on the 
=U 


interval [0, x] if 0 < x < 1, and on [x,0] if —1 < x < 0. Therefore, g(x) is 
a well-defined Riemann integral when —1 < x < 1. We are interested to extend 
the definition of g(x) tox = 1 and x = —1. But f is not bounded on (—1, 1), so 
we cannot define the Riemann integral of f on [0, 1] or [—1, 0]. Our studies on the 
function sin x shows that g(x) = sin~' x when x € (—1, 1). Thus, 

jim g(x) = sin +1 = _ jim, 9(2) = sin'(—1) = = 


Hence, it is reasonable to say that the improper integrals 


| i 
——__dy and —___qdy 
/ V1 —u? / V1 —u2 
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have values 


lim an lim 


ie 1 
du = ae 
aim [ /1 — u? ° 2 L>— ff tu 2 


respectively. This is how we are going to make sense of improper integrals. 


Definition 4.13 Improper Integrals of Unbounded Functions 


1. If the function f : (a,b] — R is not bounded, but it is bounded and 
Riemann integrable on any interval [c, b] with a < c < b, then we say 


that the improper integral [ft f(x)dx is convergent if the limit 


tim [409 


exists. Otherwise, we say that the improper integral is divergent. When 
the improper integral is convergent, we define its value as 


b 


"Fle jd = lim Tnene 


coat Cc 


. If the function f : [a,b) — R is not bounded, but it is bounded and 
Riemann integrable on any interval [a,c] with a < c < 6, then we say 
b 


that the improper integral | f(x)dx is convergent if the limit 


lim j Ties 


cob Ja 


exists. Otherwise, we say that the improper integral is divergent. When 
the improper integral is convergent, we define its value as 


[ fear = im [sear 
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Improper Integrals of Unbounded Functions 


Putting in another way, if the function f : (a, b] + R is not bounded, but it 
is bounded and Riemann integrable on any intervals [x,b] whena < x < b, 


we define the function F’ : (a, b] > R by 


F(x) = ii f(u)du. 


Then F' is a continuous function. We say that the improper integral 


b 
if f(x)dz is convergent if and only if 


lim F(z) 


wat 


exists. Similarly, for a function f : [a,b) — R that is not bounded, but is 
bounded and Riemann integral on any intervals [a, 7] when a < x < b, we 
b 


say that the improper integral / f(x)dz is convergent if and only if the 


continuous function F' : [a, b) “'R defined by 


F(t) = / flu)du 
has a limit when x > b-. 


Example 4.29 


dx is an improper integral as the function f : [0,1) > R, 


anaes 
i V1 — 2? 


1 
f(x) = —— —= is not bounded. We have seen that this improper integral 
Va 


: T 
is convergent and has value a 


Example 4.30 


Let p be a positive number. Determine those values of p for which the 
1 


improper integral — dt is convergent. Find the value of the improper 
z 


0 
integral when it is convergent. 
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Solution 
For p > 0, define the function F’ : (0, 1] > 


—Ing, 1 
ia) i 

ep 

1 pp 


From this, we see that lim F(a) exists if and only if 0 < p < 1. Hence, 
«—0 


1 
1 
the improper integral | — dx is convergent if and only if0 < p< 1.In 
Ge 


this case, 
rt 1 
—i = ——., Nap 1 
g =P © 


il! 
When r > 0, the integral | x' dx is just an ordinary integral. However, we 
0 


1 
will sometimes abuse terminology and say that the integral | x' dx is convergent 
0 


if and only ifr > —1. 


If cis a point in (a,b) and we have a function f : [a,b] \ {c} — R that is 


b 
not bounded, we will define the improper integral / j(w)da as 


[ sae a [ seme 


We say that the improper integral i f(x)dx is convergent provided that 


a 


c b 
both improper integrals / f(x)dx and / f(x)dz are convergent. 


Next we consider improper integrals defined on unbounded intervals. 
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Definition 4.14 Improper integrals on Unbounded Intervals 


1. If f : [a,oo) — R is a function that is bounded and Riemann 


integrable on any bounded intervals [a,b], we say that the improper 


integral f (x)dz is convergent if the limit 


a 


tn i “Qi 


b-0o 


exists. Otherwise, we say that the improper integral is divergent. If the 


improper integral is convergent, we define its value as 


[ f(x)dx = jim ip f(a)de. 


_ If f : (—oo,b| — R is a function that is bounded and Riemann 


integrable on any bounded intervals [a,b], we say that the improper 


b 
integral / f (x)dz is convergent if the limit 


b 
lim flajdz 


a——oo 


exists. Otherwise, we say that the improper integral is divergent. If the 


improper integral is convergent, we define its value as 


b b 
/ f(z)dc = lim Ta ids. 


a——co 


. If f : R > Ris a function that is bounded and Riemann integrable 


on any bounded intervals [a,b], we say that the improper integral 
/ f(x)dx is convergent if and only if for any real number c, both 


the improper integrals 


ee Ge teas and ie Wee teas 


are convergent. In such a case, we define the improper integral as 


ie CG — ie f(a)dx + i fla)de. (4.10) 
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Remark 4.8 


(oe) 


To make the integral f(x)dx well defined when it is convergent, we 


need to check that the ‘right hand side of (4.10) does not depend on the 
point c. In fact, we can show that if there is a real number co so that both 
the improper integrals 


[- f (eax and ip f (elds 


are convergent, then for any other values of c, 


[. i (ede and [ (ods 


are convergent. This is just due to additivity, which says that 


[ s@ae= f° sac f fle)ae, 


[ eae = [PO seae+ [tee 


co 
Thus, lim f(x)dzx exists if and only if lim f(x)dzx exists, and 
= a 


——00 


a a 


b b 
iim i) f (x)dz exists if and only if iim / f (a)dzx exists. Moreover, 
00 J. cic 


co 


lim circ = lim f(a)de + oe 


a——co a—— CO 


a ‘ a : 
lim [sows | Fla)de + jim f fiajdn. 


b> 00 


Cc co 
Since i) f(Qodc= -{ f (x)dx, we find that 
co c 


[teres [ peode= fi trae [ soyae. 


Chapter 4. Integrating Functions of a Single Variable 337 


Improper Integrals on Unbounded Intervals 


Putting in another way, if f : [a,oo) — R is a function that is bounded 
and Riemann integrable on any bounded intervals, we define the function 
F': [a,oo) > Rby 


Oe) f(ujdu. 
Then F' is a continuous function. We say that the improper integral 


i f(x)dzx is convergent if and only if the limit 


lim F(z) 


ZL—Co 


exists. Similarly, for a function f : (—oo,b] — R that is bounded 
and Riemann integrable on any bounded intervals [a,b], we say that the 


b 
improper integral i f(x)dx is convergent if and only if the continuous 


function F' : (—oo, b] > R defined by 


Faye / ” Fu)deu 


has a limit when x — —oo. 


Example 4.31 
Let p be any real number. Determine those values of p for which the 


improper integral i — dx is convergent. Find the value of the improper 
Lr 


i 
integral when it is convergent. 


Solution 


For a fixed real number p, define the function F’ : [1,00) > | 


x 


1 
—dx. 
UP 
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haze, icone 
IG) Pl 

—_—_—_ if ie 

= ne Os 


From this, we see that the limit lim F(x) exists if and only if p > 1. Hence, 
xL—-Co 


al 
the improper integral / — dx is convergent if and only if p > 1, and 
ee 


Example 4.32 


Determine whether the improper integral is convergent. If yes, find the 
value of the integral. 


ee 1 
(@) / jane 
0 
(b) / e* dx 
oie 
(°) ee aaa 
Solution 


d 1 
(a) Since 7 tanta = ees we find that 


b 

1 

| —_dr = tan-'b — tan7'0 = tan! bd. 
0 1 + i 


Since 


’ 


lim tan’! b = a 
boo y) 


co 
the improper integral i ware is convergent and its value is 
0 @ 
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om 1 1 
if dx = lim dx = lim tan7!b = - 
0 


1+ ye? b> 00 0 ++ ye? b-00 
(b) Since e* + 0 as a + —ov, we have 


- a——oo 
ae O=—E5 II, 


0 0 
/ ie —oelinn edi lita ele hale 


0 
The improper integral if e* dx is convergent and is equal to 1. 


OO) 


(c) Here, we consider the improper integrals 


Since 


we find that 


b 
x 1 
= 
ees 2 


lim In(1 + 6?) = oo. 
b—00 


Hence, the improper integral i at is divergent. So, the 
(ee 
improper integral i epee dx is also divergent 
=e ; 
prop 8 ae] 8 


—oo 


One is tempted to define the improper integral ‘: f(x)dx as 


a 


lim f(x)dx 


if it exists. For part (c) in the example above, f(x) = i - 5 is an odd function. 
z 
Thus, 7 Tot = 0 for any a, and so 


a 


a 


lim ee = 0. 


2 
a-oo tg Pa 
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In fact, if f : R — R is an odd function, then we always have 


a 


lim _f Zar—0. 
a—-oo 
If we use the limit : 
lim _f (as 
aco 


as a definition for the improper integral ue f(«x)dzx, it will lead to undesirable 


(oe) 
results, such as that the integral / xdzx is convergent. Nevertheless, the limit 
—oCo 
a 


lim flej\de 


a-oo J_a 


if it exists, has some applications. It is called the Cauchy principal value of 


ia f(a jde. 


Definition 4.15 Cauchy Principal Value 


If f : R — Ris a function that is bounded and Riemann integrable on 


any symmetric bounded intervals |—a, a], the Cauchy principal value of the 


improper integral i f(x)dzx, denoted by P.V. 7 f (x)dz, is defined as 


—oco 


P.V. f(a Vi lina Ric dx 


a—- oo 


if the limit exists. 


(oe) 


Thus, we find that if f : R — R is an odd function, then P.V. i (dar =O; 


—oo 


It is also easy to prove the following. 


Proposition 4.34 


If the improper integral ie f(x)dx is convergent, then its Cauchy 


principal value exists, and is equal to the improper integral. Namely, 


PV. [. Fade = HONE 
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If the improper integral if f(x)dx is convergent, then the limits 


lim Fe )dx and lim ror 


c>—0o boo 0 


exists and 


© f(a) dx = lim Ric \de+ lim | f(x 
[fe ff 


b> 00 


This implies that 


ayy Ric yar = tim [Ho yae+ jim, [Fle jar = fo 1@ 


Consider the integral 


1 


The function f : (0,00) > R, 
ix 
J/zx(x + 1) 


is not bounded on any interval (0,6] when b > 0. Hence, the integral is an 


f(t) = 


improper integral of an unbounded function defined on an unbounded interval. 
Using the same principle, we will say that it is convergent if and only if for any 
c > 0, the improper integrals 


[ teoae and [ oe 


Another natural question to ask is whether one can determine whether an 


are convergent. 


improper integral is convergent without explicitly computing the integral. There 
are some partial solutions to this. 


If J is an interval that is contained in the interval J, and the integral 


| f(«x)dzx is divergent, then the integral i f (x)dzx is divergent. 
5; I 
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For instance, the integral | f(«x)dzx is divergent if the integral / jas 
0 1 


is divergent. 
The next proposition says that linear combination of convergent integrals must 
be convergent. 


Proposition 4.35 Linearity 


Let J be an interval. If the improper integrals / f(x)dx and | g(x)dzx are 
I I 


convergent, then for any constants a and (3, the improper integral | (af + 


I 
Gq) is also convergent, and 


flor+sa=af tra fo 


This follows easily from limit laws. Now we want to prove some comparison 


theorems for improper integrals. We start with integrals of nonnegative functions. 
If a function f is nonpositive, one just consider the function —f, which is then 
nonnegative. 


Lemma 4.36 


Let J be an interval. Given that f : J — R is a nonnegative function that is 


bounded and Riemann integrable on any closed and bounded intervals that 


are contained in J. Fixed Zo in J and define the function fF’ : J — R by 


Gy= / aa 


. If J = (a, 6] or J = (—cv, b, then the integral | f(x)dx is convergent 


I 
if and only if the function F(x) is bounded below. 


. If J = [a,b) or J = [a, oo), then the integral | f(x)dx is convergent if 


i 
and only if the function F(x) is bounded above. 
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Notice that since f(u) > 0 for all u € J, for any x; and x in J, if x1 < 22, 
then 


F(t) —F(es) =f fw)du > 0. 


This implies that F’ : J — R is an increasing function. 


1. If J = (a, 6] or I = (—on, 8], the limit lim F'(x) orthe limit lim F(z) 
zZ—a L—+— CoO 


exists if and only if F’(a) is bounded below. 


2. If J = |a,b) or J = [a,oo), the limit lim F'(x) or the limit lim F(z) 


r—b- t—0O 
exists if and only if F'(x) is bounded above. 


In Proposition 4.34, we have stated that if the improper integral - f (x)dzx is 


convergent, then the Cauchy principal value P.V. / f (x)dzx exists. The converse 


is true if the function f : R — R is nonnegative. 


Theorem 4.37 


Let f : R — R be a nonnegative function that is bounded and Riemann 


integrable on any closed and bounded intervals. The improper integral 


i f(x)dx is convergent if and only if the Cauchy principal value 


P.V. / f (x)dzx exists. Moreover, 


[ tear=ev. [sear 


We just need to show that if the Cauchy principal value P.V. i 


—co 


(oe) 
exists, then the improper integral / f(x)dx is convergent. 
—oo 
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(oe) 


Assume that the Cauchy principal value P.V. / f (x)dz exists and is equal 


to J. As in the proof of Lemma 4.38, the function 


F(z) = / Aeaee 


is an increasing function. For any real numbers b and c with b < c, there is 
a positive number a such that 


-—a<b<cK<a. 


Hence, ‘ . 
F(c) — F(b) = | f(a)dx < i foun <i 


This proves that —I < F(x) < J forall x € R. In other words, the function 
F : R > Ris bounded. Therefore, the improper integrals if f(x)dx and 
0 


0 co 
i f(x)dx are convergent, and so the improper integral / Ce dats 


convergent. 


Now, we can present the comparison theorem for improper integrals. 


Theorem 4.38 Comparison Theorem 


Let J be an interval. Given that f : J + Rand g: I — R are nonnegative 


functions that are bounded and Riemann integrable on any closed and 
bounded intervals that are contained in J. Assume that 


O= Fa aa) for all x € I. 


. If the integral i g(x)dzx is convergent, then the integral i f(x)dzx is 
I I 


convergent. 


. If the integral i f(x)dx is divergent, then the integral ) g(x)dx is 
I I 
divergent. 
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Notice that the second statement is the contrapositive of the first statement. 
Hence, we only need to prove the first statement. Fixed 2 in the interval J, 
and define 


Fa) = f “fla 


lif 42 > aay. 
Ore Ee): 


Therefore, G' is bounded above implies F' is bounded above. If x < 20, 


Fa)=— [flute 


o< [ " flu)du < / * g(u)du, 


we find that 
ee alee) ela 


Therefore, G is bounded below implies that F’ is bounded below. The 
assertions about the convergence of the integrals then follow from Lemma 
4.36. 


Example 4.33 


(oe) 


We can show that the integral i dx is divergent without explicitly 


2 
@ Ue? or 
computing the integral. Notice that for x > 1, 


x 
= 


12s 
De eee ss 


: ; an en : na : 
Since the integral ‘i —dz is divergent, the integral i aad dx is also 
itt x 1 eet 1 
divergent. Hence, the integral i = dx is divergent. 
0 «6 ar 1 
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Example 4.34 


a 1 
Determine whether the improper integral —————~ dx is convergent. 


Solution 
We determine the convergence of the two improper integrals 


dx and dx 


|, Fee | ern 


separately. For0 < x <1, 


es : < : 
~ Vale +1) ~ Ve 


1 
Since the integral ly ——dz is convergent, the integral ————- dz 


- 


is convergent. For x > 1, 


[ ier) 


1 1 1 
0< < ay 
St lee 2 


[oe) 
: : 1 : : 
Since the integral / 5 dx is convergent, the integral 
il xv 


dx is convergent. From these, we conclude that the 


integral dz is convergent. 


ee 
0 va(r+1) 


1 
Since the integral i x ?dx is convergent when p < 1, while the integral 
0 
[oe] (oe) 


x ?dx is convergent if p > 1, x ?d«x is not convergent for any values of 


a Hence, to determine the convergence of the integral in the example above, we 
need to split the integral into two parts and compare to different g(a) = x2”. For 
x —> 0*, we ignore the part 1/(a + 1) which has a finite limit. For 7 — oo, the 
leading term of 1/(x + 1) is 1/x. This is how we identify the correct values of p 
to compare to. 

Theorem 4.38 provides a useful strategy to determine the convergence of an 
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integral in the case that the function is nonnegative. For a function that can take 
both positive and negative values, we need other strategies. 


Theorem 4.39 


Let J be an interval. Assume that f : J — R is a function that is 


bounded and Riemann integrable on any closed and bounded intervals that 


are contained in J. If the improper integral | | f(x) |da is convergent, then 
I 


the improper integral | f(x)dz is convergent. 
I 


This theorem can be interpreted as absolute convergence implies convergence. 


Define the functions f, : J + Rand f_:I—- 


f(x) = max{ f(z), 0}, 
In other words, 


if f(x) > 0, 
if f(x) <0, 


if f(x) <0, 
itt (a 0: 
Notice that f, and f_ are nonnegative functions, and 


f(z) = f(z) — f-(@), Ife) = Ale) + L(@). 


The second equality implies that 


0< f(z) SIF@)I, O< f_(x) <|f(#)| forall x € I. 


Theorem 4.23 says that the function |f| : J —> R is Riemann integrable on 


any closed and bounded intervals that are contained in /. 
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Question 4.3.5 says that the functions f+ : J — Rand f_:J—7~ R 
are also Riemann integrable on any closed and bounded intervals that are 


contained in J. By Theorem 4.38, the improper integrals | f.(x)dx and 
a 


i f_(x)dz are convergent. By linearity, the improper integral | f(x)dz is 
I i 
also convergent. 


Combining Theorem 4.38 and Theorem 4.39, we have the following. 


Theorem 4.40 General Comparison Theorem 


Let J be an interval. Given that f : J — Rand g: J — Rare functions that 
are bounded and Riemann integrable on any closed and bounded intervals 
that are contained in J. If 


Gal SeiGe) for all x € J, 


and the integral i g(x)dz is convergent, then the integral | f(x)dz is 


I se 
convergent. 


Example 4.35 


dx is convergent. 


> sine 
Show that the improper integral ‘A 5 
i. ee 


Solution 
For any x > 1, 
sin x 
ge | g2 


: : eal ; ; Sint 
Since the integral — dx is convergent, the integral —,dz is 
1 & 1 x 


convergent. 


There are some important special functions in mathematics and physics which 
are defined in terms of improper integrals. One such function is the gamma 
function, which students have probably seen in probability theory. In fact, gamma 


function is ubiquitous in mathematics. 
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Example 4.36 


Let s be a real number. Show that the improper integral i een dis 
0 
convergent if and only if s > 0. 


Solution 


Il le) 
We split the integral into the two integrals i te ‘dt and i teens: 
0 1 
Notice that 


for all t € (0, 1]. 


1 i 
Since i t®-'dt is convergent if and only if s > 0, | Pe “di is 
0 0 


convergent if and only if s > 0. For the integral ‘i t*-'e~'dt, notice 


ile 
that 
ts-1 


: c= 1) — 7p = 
phn e es et/2 
Therefore, there is a number ty > 1 such that for all t > to, t®-be~*/? < 1. 


Now the function 


0. 


g(t) = to-le-t/2 


is continuous on the interval [0, to]. Hence, it is bounded on [0, to]. These 
imply that there is anumber / > 1 such that 


eee = Vl for all t > 1. 
Hence, 
) Pe le for allt > 1. 


lo) [o-e) 
Since the integral i e- -diis convergent, the integral | te “dhis 
1 it 
convergent. 


(oe) 
Hence, the integral ik t®-'e~‘dt is convergent if and only if s > 0. 
0 
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The Gamma Function 


The gamma function I'(s) is defined as the improper integral 


i tre a 
0 


when s > 0. It is easy to find that 


T(1) | eds = 1, 
0 


When s > 0, using integration by parts with u(t) = t® and v(t) 
we have 


I(s + 1) 


b 
{Leet + | tena} 


lim {a*’e~* — be? } + sI(s) 
aot 
b- 00 


= sl (a) 


This gives the formula 
I'(s+1) =sI(s). 


By induction, one can show that 
Tin+1)=n!. 


Hence, the gamma function is a function that interpolates the factorials. 


) = [ feels 
0 


Students have probably seen in multivariable calculus or probability that 


Another special value is 


/ ce dr = Jn. 


oe) 
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Making a change of variables t = u”, we find that 


love) b 
poeteetat = tim [itera 
0 aot 
b—00 


lim 2 
aot 
boo 


Hence, 


=f Peat = vr. 


0 


In the future, we are going to explore more about the gamma function. For 
example, we will prove the useful formula for the beta integral, which says 
that ifa > 0, 6 > 0, 


3 e=1/) B=) ye P(a)I (6) 
fo (1 -t) Oe Tie a 


A lots of other proper or improper integrals can be transformed to this. 
When a and &£ are positive integers, this formula can be proved by 
induction. See Question 4.5.4. 
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Exercises 4.6 


Question 1 


(oe) 
Let a be a positive real number. Show that the integral i; e “dx is 
0 


convergent and find its value. 


Question 2 
on 2 
Let n be a positive integer. Find the value of the integral | een a 
0 


Question 3 


Explain why the given integral is an improper integral, and determine 
whether it is convergent. If yes, find the value of the integral. 


Le 


0 
DG 
(a) i a! 


1 
(b) | Jz ln xdz 
0 


2 dz 
. [ (@—1)? 


Question 4 


Determine whether the improper integral is convergent. If yes, find its 


value. 


© Ver 


0 | 
(b) i — de 
1 x 
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Question 5 


Determine whether the improper integral is convergent. 


@ fa d 
San aE ae 


il et 
(b) | — dx 

0 Vx 

2m sing 


[o-e) 7 
© i (+04 pe 
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Chapter 5 
Infinite Series of Numbers and Infinite Products 


In this chapter, we discuss infinite series of numbers and infinite products. 


5.1 Limit Superior and Limit Inferior 


In Chapter 1, we have seen that a bounded sequence might not be convergent. In 
this section, we will discuss the concepts called limit inferiors and limit superiors, 
which characterize the limits of subsequences of a sequence. 


First we extend the definitions of supremum and infimum as follows. 


Extensions of Infmum and Supremum 


. If anonempty set S is not bounded below, we write inf S = —oo. 


. If anonempty set S is not bounded above, we write sup S = oo. 
. inf{—oo} = —oo, inf{co} = oo. 


. sup{—oco} = —oo, sup{oo} = oo. 


The definition of limits are also extended to include —oo and o as limits. 


Theorem 5.1 


Let {a,,} be a sequence of real numbers. 


1. The sequence {a,,} is not bounded above if and only if there is a strictly 


increasing subsequence {a,,, } such that jim ni Oo: 
00 


2. The sequence {a,,} is not bounded below if and only if there is a strictly 


decreasing subsequence {a,,, } such that lim a,, = —oo. 
k—+00 
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It is sufficient to prove the first statement. If there is a subsequence {a,, } 


of {a,,} such that jim An, = ©, it is obvious that {a,,} is not bounded 
00 


above. 

Conversely, given that {a,,} is not bounded above, we want to construct a 
strictly increasing subsequence {a,,, } such that iim He == eee Uy = IL, 
Since {a,,} is not bounded above, there is an2 > 1 such that a,, > ap, +1. 
Assume we have found nj, n2,...,%%—1, such that 


Mi <a K 9° << Waa, 


and 
Ga 2 Gn forall 1 <7<k-2. 


Since {a,,} is not bounded above, there is ann, > nm,_1 such that a,, > 
Qy,_, + 1. This constructs a strictly increasing sequence {a,,, } inductively 
which satisfies 


Greg = One for all k € ZT. 
From this, we find that 
Dron, 22 Woy AP 


Therefore, lim an, = 00. 
k- 00 


Associated with a given sequence {a,,}, we can define two sequences {b,, } 
and {c,}. 
Definition 5.1 


Given a sequence {a,,}, we can define two sequences {b,,} and {c,,} as 
follows. For each positive integer n, 


b= inl a, — into ee. CG, — supa, —<Upi a. | hk = ay 
k>n k>n 
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Example 5.1 


1 
For the sequence {a,,} with a, = —, 
n 


for all n > 1. 


Example 5.2 


For the sequence {a,,} with a, =n, 

ie. Cr =CS for all n > 1. 
Example 5.3 
For the sequence {a,,} with a, = (—1)”, 


b, = -1, Cy = il for all n > 1. 


The following are obvious from the definitions and Theorem 5.1. 


Proposition 5.2 


Given that {a,,} is a sequence of real numbers, for each n € Z*, let b, = 


inf a, and c, = sup dg. 
kon k>n 


1. For any positive integer n, by < Gn < Cp. 


2. For any positive integer n, b,, cannot be oo, c, cannot be —oo. 


. {a,,} is not bounded below if and only b,, = —oo for all n > 1. 


. {a,,} is not bounded above if and only if c,, = 00 for all n > 1. 
. {b,,} is an increasing sequence. 


. {Cp} is a decreasing sequence. 


Since {b,,} is an increasing sequence, lim b,, = sup{b,,} in the general sense. 
Nn—-oo 


Similarly, lim c, = inf{c,}. 
n—-co 
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Definition 5.2 Limit Inferior and Limit Superior 


Let {a,,} be a sequence of real numbers. 


1. The limit inferior or limit infimum of {a,,}, denoted by lim inf a,, or 
Nn ooO 


lim a,, 1s defined as 
N—- oo 


himainta, — dim > — sup mt a,. 
n—+00 n—-0o n>1 k2n 


2. The limit superior or limit supremum of {a,,}, denoted by lim sup a,, or 


n—- co 


lim ap, is defined as 
N—- Co 


limsupa, — lim c, = mf sup az. 
n—-00 =e) n21 E>n 


Notice that using extended definitions of infimum and supremum, the limit 
infimum and limit supremum of a sequence always exist, either as a finite number, 


or +00. 


Example 5.4 


1 
1. For the sequence {a,,} with a,, = — defined in Example 5.1, 
nr 


limaaimt a, 0), lim supa, = 0. 
W729) n—>00 


2. For the sequence {a,,} with a, = n defined in Example 5.2, 


limaini a, = oo, lim sup G, = 00. 
Nae) n—00 


3. For the sequence {a,,} with a, = (—1)” defined in Example 5.3, 


lim inf a, = —1, lim sup a, = 1. 
Des n—-00 


The following are obvious. 
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1. liminf(—a,) = —limsupa, 
Wesraos. n—>00 


2. limsup(—a,) = — liminf a,. 
n—0o n—?00 


Since 
bi = Cy for alln € Zt, 


we obtain the following immediately. 
Proposition 5.3 


For any sequence {a,}, 


lim inf a, < limsupa,. 
Wes N—+00 


We also have the following comparison theorem. 


Proposition 5.4 
Let {u,,} and {v,,} be sequences of real numbers. If u,, < vp for all positive 


integers n, then 


lim inf uw, < lim inf v,, lim sup uy, < limsup vy. 
N—-+O0o Noo noo n> Co 


Example 5.5 


Find lim inf a, and lim sup a,, for the sequence {a,,} defined by 
aac) nc 


a= (-r(1+2) 


Solution 


Notice that for any n > 1, 


1 
Gan—1 = —1— 
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We observe that 
ay <ag<---<-l<l<---< a4 < ay. 


The sequence {a2n_1} increases to —1, while the sequence {a2,,} decreases 
to 1. Therefore, 


1 ee ee. 
In+1’ CH= = Op = on’ 


bon om bon+1 = 
It follows that 


hininia, = lim b,— — 1, limneupa, — lime, — i 
Meo N00 n—-0o N+ 0o 


Example 5.6 


Let {a,,} be the sequence defined by a, = (—1)"n. Find lim inf a, and 


P N00 
lim sup dy. 
n> oo 


Solution 
For any n > 1, 


Qan—-1 = —(2n — 1), oe — iy 
The sequence {a,,} is not bounded below nor bounded above. Therefore, 
b, = —00, Cn = 6S: 
It follows that 


lim inf a, = —oo, lim’ sup @,, = Go. 
Aree, n—+00 


For a monotoic sequence, it is easy to find its limit inferior and limit superior. 
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Theorem 5.5 


Let {a,,} be a monotonic sequence. 


1. If {a,} is increasing, then b,, = a,, and c,, = sup{a,,}. Therefore, 


lhminta, — lim supa, — lima, — sup, a, } 
nN—-0o 


n—-oco n—-oo 


2. If {a,,} is decreasing, then b,, = inf{a,,} and c, = a,. Therefore, 


lininta.—limecupa, — limea, — initia, 
nN—-0o n—-0o n—- oo 


In other words, for monotonic sequence, the limit inferior, limit superior, and 


the limit are all the same. 


In fact, if a sequence {a,,} has a finite limit, then its limit inferior, limit 


superior and limit are all the same. 


Theorem 5.6 


Let {a,,} be a sequence, and let a be a finite number. Then the following 


two statements are equivalent. 
(a) lim a, =a. 
N+ 0o 


(b) liminf a, = limsupa, = a. 
N—00 n—0o 


For a positive integer n, define b,, = inf az, Cn = SUPps,, An. Then 
k>n = 


limanie,,— lime 5,,. linisup@, — lime, 
n—oo N—>00 WANES noo 


By definition, 
Dy Sg Ss Cy. 


Hence, (b) implies (a) follows from squeeze theorem. 
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Now we prove that (a) implies (b). Given ¢ > 0, since lim a, = a, there 
N—- Oo 
is a positive integer N such that for alln > N, 


ae < eae 
a-~<Q,<at+-. 
2 y 


Hence, for all n > N, 


ben & ie 
a- = n<atn- 
2 2 


These prove that for alln > N, 


|b, —al <eé and ICn — al <€. 


lim inf a, = limsupa, = a. 
N00 n—0oo 


Hence, we are left to consider sequences which does not have a finite limit. 
Let us first characterize when the limit inferior and the limit superior of a sequence 


can be —oo or oo. 


Theorem 5.7 
Let {a,} be a sequence of real numbers. Then the following three 


statements are equivalent. 


(a) limsupa, = oo. 
noo 


(b) {a,,} is not bounded above. 


(c) There is a strictly increasing subsequence {a,,, } such that jim = 
00 


CO. 


Notice that limsupa, = tim Cn, Where c, = ue az. Since {c,} is a 
noo p= 


decreasing sequence, jim, Cn = co if and only if a = oo forall 7 > 1. 


Hence, this theorem follows from Theorem 5.1 and Proposition 5.2. 
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The limit inferior version of Theorem 5.7 is straightforward. 


Theorem 5.8 


Let {a,} be a sequence of real numbers. Then the following three 


statements are equivalent. 


(a) liminf a, = —oo. 
n—- oo 


(b) {a,,} is not bounded below. 


(c) There is a strictly decreasing subsequence {a,,, } such that im — 
—> OO, 


—cC. 


What is more nontrivial is when limit superior is —oo, or limit inferior is 00. 


Theorem 5.9 


Let {a,,} be a sequence of real numbers. 


1. limsup a, = —oo if and only if lim a, = —oo. 
n—0oo N00 


2. liminf a, = co if and only if lim a, = oo. 
noo n—-oo 


Notice that if limsupa, = —oo, we must have lim inf a, 
n—-oo 


nN co 
Similarly, if lim inf a, = oo, it is necessary that lim sup a,, = oo. 
N00 n—00 


It is enough for us to prove the second statement. Let b,, = inf ap. Notice 
>n 


that b,, < a,. If lim inf Qn = lim b, = oo, we must have Tim On = CO: 
noo 


Conversely, sqammne Since lim a, = oo. Given M > 0, mew! a a positive 
noo 


integer NV such that 
An > M foralln > M. 


This implies that 
b, > M foralln > M. 


Hence, lim inf Op, = lin b, = So. 
n—- Ooo 
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Example 5.7 


Consider the sequence {a,,} with a, = n+ (—1)". The first few terms 


are given by 0,3,2,5,4,7,.... This sequence is neither increasing nor 
decreasing. For any n > 1, 


Pye) ln — Oe 2, 
while c,, = o0 for all n € Z*. Therefore, 


liminika-s— slim oe—— 
noo {Ure 2} 


Combining Theorem 5.7, Theorem 5.8 and Theorem 5.9, we can summarize 


the cases where the limit inferior or the limit superior is —oo or oo. 


Infinities as Limit Superior or Limit Inferior 


Let {a,,} be a sequence of real numbers. 


1, imuinid,; = nm op Gy, = —oo if and only if jim, GQ, = —oo. In this 
Noo 


case, {a,,} is bounded above, not bounded ieione. 


_immic., = cay ey Gy, = oo if and only if jim Gy = oo. In this case, 
Noo 


{dn} is bonnded| below, not bounded above. 


. liminf a, = —oo and lim sup a, = oo if and only if {a,,} is not bounded 
n—-co 


above nor bounded Pale a 


. —oo < liminfa, < oo and nEnSUD a, = oo if and only if {a,,} is 
noo 


bounded below but not bounded clove: 


. liminfa, = —oo and —oo < Ines ea dy, < oo if and only if {a,} is 
n—->co 


bounded above but not bounded bee. 


The following gives a relation of limit inferior and limit superior with limits 
of subsequences. 
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Theorem 5.10 
Let {a,,} be sequence with 
liminfa, =b and limsupa, =c. 
n— 00 n—0o 
If {a,, } is a subsequence of {a,,} that converges to a number @, then 


og l<e@ 


Here b and c can be oo. 


For every positive integer n, let 


b, = int Gp, 
k>n 


Then 


pio. C= limnc. 
n—- Ooo n—-oo 


Given a subsequence {a,,}, {bn,} and {c,,} are subsequences of the 
monotonic sequences {b,,} and {c,,}. Hence, we have 


limb; — 0; NiaieGe 6. 
k->00 k-00 
which still holds in the extended sense. Since 


ee eee for all k € Zt, 


we find that 


Now we turn to the case of finite limit superior and finite limit inferior. We 
have the following equivalence. 
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Theorem 5.11 
Let {a,,} be a sequence of real numbers. Then the following two statements 
are equivalent. 


(a) limsupa, = cis finite. 
Noo 


(b) Given e > 0, 


(i) there exists a positive integer NV such that for alln > N, a, < 
c+eé; and 


(ii) for every positive integer V, there exists an integer n > N, such 
that a, > c—e. 


For a positive integer n, define c,, = sup ay, so that limsupa,, = lim Cp. 
k>n n—>00 Wace’ 
Let us first prove that (a) implies (b). Given ¢ > 0, since lim c, = c, there 


Noo 
is a positive integer N such that for alln > N, |c, —c| < ¢. Ifn > N, we 
find that 


An < SUP An = Cn < C+E. 
k>n 


This proves (b)(i). Now given ¢ > 0, there is a positive integer No such 
that c—¢ < c, < c+e forall nm => No. For any positive integer N, let 
N' = max{N, No}. Then N’ > No. Hence, 


SUP Gp = Cn’ > C—E. 

k>N! 
This implies that c — € is not an upper bound of {a;|k > N’‘}. Therefore, 
there is ann > N’ > N such that a, > c — €. This proves (b)(ii). 
Now we prove (b) implies (a). Given ¢ > 0, (b)() implies that there is a 
positive integer N such that for alln > N, 


<— C+; 
De OP 
Z 
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This implies that for alln > N, 


€ 
ee SC Sa 


For any n > N, (b)(ii) implies that there is ak > n such that a, > c—e. 
Therefore, c, > a, > c — €. This shows that for alln > N, 


C-—E< CG, <M CHE. 


Hence limisup a. — iim cc 
n—-oo nN—-0oo 


The limit inferior counterpart of Theorem 5.11 is the following. 


Theorem 5.12 
Let {a,,} be a sequence of real numbers. Then the following two statements 
are equivalent. 
(a) liminf a, = 61s finite. 
noo 

(b) Givene > 0, 

(i) there exists a positive integer NV such that for alln > N, a, > 

b—e; and 


(ii) for every positive integer NV, there exists an integer n > N, such 
that a, <b+e. 


The following theorem says that the limit inferior and the limit superior are 
limits of subsequences. 


Theorem 5.13 


Let {a,,} be a sequence. 


1. If c = limsup a, is finite, it is the limit of a subsequene of {a,, }. 


N—->Co 


2. If b= liminf a, is finite, it is the limit of a subsequene of {a,}. 
Noo 
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It is sufficient for us to prove the first statement. We use (b)(11) of Theorem 
5.11. Take « = 1 and N = 1. There is an integer n,; > 1 such that 
Gn, > C— 1. Suppose we have chosen 71, 72,...,%—1 such that ny < 


Ng <...<Mp_1 and 


if 
Le foralll1 <7 <k-1. 
J 


Take « = 1/k and N = nx_; + 1. There is anny > N > ng_y such that 
Gn, > C — 1/k. By induction, we have constructed the subsequence {a,,, } 
with 

dng > 6-7 forall k € Z™. 


Notice that we also have an, < Cy,. Therefore, 


1 
CH F< Ong S Cn forall k € Z. 


Being a subsequence of {c,}, jim Cn, = c. By squeeze theorem, 
—0o 


Lice, 
k- co 


Theorem 5.7, Theorem 5.8, Theorem 5.10 and Theorem 5.13 give 


characterization of limit superior and limit inferior as follows. 


1. The sequence {a,,} is not bounded above if and only if lim sup a, = co, 
if and only if there is a strictly increasing subsequence ae such that 
fim ng = 08 

. The sequence{a,,} is not bounded below if and only if lim inf OCs 


if and only if there is a strictly decreasing subsequence {a,,, } such that 


hineey. = =ce: 
k-0o 


Chapter 5. Infinite Series of Numbers and Infinite Products 368 


3. If the sequence {a,,} is bounded above, there is a subsequence {a,,, } 


such that lim a,, = limsupa,. 
k-oo n—0o 


4. If the sequence {a,,} is bounded below, there is a subsequence {a,,, } 


such that lim a,, = lim inf a,. 
k-0o n—0o 


5. The limit of any subsequence {a,,,} must be between lim inf a, and 
noo 


lim sup dy. 
{cer a, 2) 


Let us look at the following example. 


Example 5.8 


Find lim inf a, and lim sup a, for the sequence {a,,} defined by 
MieOO N—+00 


_ an 
An = sin ——. 


5 


Solution 
For any n > 1, 


: as : 
A5, =O, A5n41 = SIN oe Q5n+2 = SIN —_ 


_ Om or 
A5n4+3 = SUL, a5n4+4 = SIN —_. 
5 5 
Hence, the limit of a convergent subsequence of {a,,} can and can only be 


21 


0, sin 


Since 


; on : Wwe : ie SE 
in — in — in — in — 
Ss 5 Ss 5 Ss 5 Ss 5? 


we find that 


see ou _ 27 
lim inf a, = sin —, lim sup a, = sin —. 
noo 3) n—0o 5 
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Exercises 5.1 


Question 1 


Find lim inf a,, and lim sup a,, for the sequence {a,,}, where 
W788) noo 


= 2n 
Ss a 


Question 2 


Find lim inf a, and lim sup a,, for the sequence {a,,}. 
Pade) n—0o 


2n 
2n+1 


ella 
2n 


(a) a, = (—1)" 
(b) a, = (—1) 


Question 3 


Find lim inf a, and lim sup a, for the sequence {a,}. 
29) n—0o 


(a) dn = —2n + (—1)"n 


(b) a, =n — 2(-1)"n 


Question 4 


Find lim inf a, and lim sup a,, for the sequence {a,,} defined by 
M700 n—00 


27n 
Qn = COS —. 
9 


Question 5 


Prove or disprove: Given two sequences {a,,} and {b,.}, 


lim sup(a,, + 6,) = limsupa, + limsup bp. 
noo noo noo 
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5.2 Convergence of Series 


In this section, we consider infinite series and its convergence. A series is a sum 
of the form 


[o,<) 


) Qn = A, + a2 


n=1 


Q 
3 


where {a,,}°°, is an infinite sequence. Sometimes a series might start with the 
n = 0 term. Since a series is an infinite sum, we need to study whether the sum 
makes sense. The natural thing to do is to define it using limits. 

For convenience, we will deal with series that starts with the n = 1 term in 
this chapter. When necessary, we will explain what changes need to be made if 
the series starts with the n = 0 term. 


Definition 5.3 Convergence of Series 


[o-e) 
Given an infinite series y dn, We define its n“ partial sum s,, by 


nl 


n 
Sn = ) Qk. 
k—t 


We say that the series is convergent or has a finite sum, if the sequence 
{Sn} has a finite limit. Otherwise, we say that the series is divergent. If the 
series is convergent, we define its sum by 


[oe) n 
y G,=s = lms, = lim y Gp. 


n=l 


(oe) 
If the infinite series s a, Starts with the n = 0 term, we still define its n™ 


n=0 


partial sum by 


n 
i= > ak when n > 0. 
k=0 


Chapter 5. Infinite Series of Numbers and Infinite Products S11 


co 


The convergence of a series ees is not affected by a finite number 


a | 
oo 


of terms in the series. Given a positive integer no, the series y Gy, 1S 


n=no 
ioe) 


convergent if and only if the series oe Gn 1S convergent. In case they are 


n=l 
convergent, 
no—1 


lo) ioe) 
) An — ) An = ) An. 
n= all 


n=no 
Example 5.9 


[o-e) 
1 1 
For the series SS pn’ = ae and the n® partial sum is 


al 


ee 
Sn = at 


1 
i ii — = find that li = jl, |el h i Ni 
Since im ori 0, we find that im Sn ence, the series a 1S 
n= 


convergent and 


el 
ee 


nl 


Example 5.10 Harmonic Series 


(oe) 
Determine whether the series 3 — is convergent. 
n 


=I 


Solution 


The n™ partial sum of the series is 
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For any positive integer n, 


Therefore, for any positive integer k, 


SISA EM AE EDTA SEES Nap A A GE 


This shows that the sequence {s,,} is not bounded above. Hence, it is not 


Co 
; ee 
convergent. Therefore, the series y — is divergent. 
n 


ail 


Example 5.10 is a typical example where we determine the convergence of a 
series without compute the exact value of its partial sum. In this section, we are 
going to learn various strategies that can be used to do so. 

From linearity of limits, we immediately deduce the following. 


Proposition 5.14 Linearity 


oe) lo) 


et Se Gy, and MB b, be convergent series. Then for any constants a and 


cal al 
ioe) 


G, the series S “(aan + (b,) is also convergent and 


(‘pal 


oe) 


S “(aan + Bb,) = aye a, + Ce oe 
n=1 n=1 


n=l 


Let us look at a simple criteria that can be used to conclude that a series is 
divergent. 


Theorem 5.15 


co 


If a series y Gd, is convergent, then lim a, = 0. Equivalently, if 
7 SO 
n=1 


[o-e) 
lim a, 4 0, then the series 2 Gy 18 divergent. 


n—-oco 


ac! 
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(oe) 
We just need to prove the first statement. If is Gy 1S convergent, the 
n=1 


sequence of partial sums {s,} converges to a number s. Notice that 


Gn = Sn — Sn—1, Where sp = 0 by default. Therefore, 


lim a¢, = lm s, = lm s,5) =s—s = 0: 
N—-0o Noo n—-0co 


(oe) 
When one is determining the convergence of a series y Gn, it is always good 


n=1 


to start with checking whether the limit lim a,, is zero. 
Noo 


Example 5.11 


[o.@) 
The series So(-1)" is divergent since the limit lim (—1)” does not exist. 
n—->co 
n=1 


Example 5.12 


Determine the convergence of the series 


» (142 


the series 


is divergent. 


The geometric series is a series which we can find the partial sums explicitly. 
It is useful for comparisons. 
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Theorem 5.16 Geometric Series 


[oe] 
The geometric series ae r” is convergent if and only if |r| < 1. Moreover, 


n=0 


co 1 
y re = —— when |r| < 1. 
ae 


n=0 


co 
When |r| > 1, the limit lim r” is not 0. Thus, the series ye r” is divergent. 
N—-0o = 
When |r| < 1, the n"™ partial sum is 
‘le prt 


Sy =ltrtr? tee tr” = ——_ 
LSP 


In this case, lim r”*! = 0, and so 
noo 


op il 
lim s, = lim = : 
noo n>co 1—fT i =F 


(oe) 
Hence, the series y r” is convergent when |r| < 1, and 


n=0 


= 1 
Sr = —— when |r| < 1. 
ve 


n=0 


co 


A general geometric series is a series of the form y (ars="); where a is 
n=1 


the first term of the series. It is convergent if and only if |r| < 1. 


(oe) 
If all the terms a,, in the series » Gy, are nonnegative, we notice that the 


n=1 
partial sums {s,,} form an increasing sequence. For an increasing sequence, we 


have the monotone convergence theorem. Applying to the sequence of partial 
sums, we have the following. 
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Theorem 5.17 


If a,, > O for all n > 1, then the series Se Gy, is convergent if and only if 
| 
the sequence of partial sums {s,,} is bounded above. 


In practice, it is sufficient that there is a positive integer N so that a,, > 0 for 
alln > N. In Example 5.10, we have used this criterion to show that the harmonic 
1 
series — is divergent. 
>, is diverg 


n=1 


Besides - geometric series, a series that is useful for comparisons is the 


1 
p-series Be . When p < 0, this series is not convergent since tim nS ss 
oom 


0. Hence, Ge will concentrate on the case where p > 0). To determine the 
convergence of this series, a convenient tool is the integral test. 


Theorem 5.18 Integral Test 


Suppose that f : [1,co) — R is a function that satisfies the following 


conditions. 
(i) f is continuous. 


(ii) f decreases to 0 monotonically. 


co 


For n > 1, let a,, = f(n). Then the series > Gp is convergent if and only 


n=] 


if the improper integral / f(x)dx is convergent. 
1 


Since f(x) decreases to 0 monotonically, f(z) > 0 for all > 1, and so 
{d,,} is anonnegative decreasing sequence with Jim a, = 0. Let s, = ai+ 


a2 +-+++4d, be the n™ partial sum of the series, and let F(x yap f(u 


when x > 1. 
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Given a positive integer n, since f is decreasing, we find that 


f(nt+1) < f(x) < f(n) forn<a2<n+1. 


This implies that 
n+1 
Ces / fia jdz = a, 


Therefore, when n > 2, 


This gives 
F(n+1) <s, <a,+ F(n). (5.1) 


If the improper integral i! f(x)dx is convergent, {F'(n)} is bounded 


il 
above by a number /. Therefore, 


Sn <a,+M for all n > 1, 


(oe) 


and so the sequence {s,,} is bounded above. Therefore, the series SS Gy, 18 
i" 


convergent. 
fore) 


If the improper integral i, f(x)dzx is divergent, iim F(n+1) =o. By 


S 1), we find that the sequence {s,,} is not eee crore: Thus, the series 


3 Gy, is divergent. 


a) 


Let us now use the integral test to determine the convergence of the p-series. 


Theorem 5.19 p-Series 


(oe) 


Let p be a positive number. The p-series Se es is convergent if and only if 
n 


il 


jo > Il 
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= 
iat 


x x 
0} 1234567891011 0} 1234567891011 


Figure 5.1: The integral test. 


Define the function f : [1,0o) >] 


Then f is a continuous function that decreases monotonically to 0. By 


eae | 
Example 4.30, the improper integral Hi — dt is convergent if and only if 
ee 


“1 
p > 1. By integral test, the series SS — is convergent if and only if p > 1. 
n 


n= 


Example 5.13 
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Remark 5.1 Integral Approximation to Partial Sums 


Given that f : [l,co) — R is a continuous function that monotonically 
decreases to 0, let 


Sn = » f(k), tp 
k=1 


From the proof of the integral test, we have 
tr t+ f(n +1) < 8) < art tn. 


This implies that 
f(nt+)) ce Se 


n 
which gives bounds for the error when the partial sum s, = PS ay IS 
k=1 


approximated by the integral / f(x)dx. When the improper integral 
i 


CO 
i: f(x)dx is convergent, the sum Oe Gy is also convergent. In this case, 
1 n=l 


the sum of the infinite series satisfies 


te fade < ym < [ f(x)dx + ay. 


oe) 


If we use s,, to approximate the sum s = 3 Gn, the error is 


iM 


[oe 
S$ —S, = y Ap. 


k=n+1 


The same reasoning shows that ifn > 1, 


[fede <s— ans f° soy 
n+1 n 
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Example 5.14 Euler’s Constant 


We can prove that the limit 


exists as follows. Let 
1 1 
(=1l+=a+---+——-Inn. 
2 n 
Then 


al aul aes 1 1 
nn = [ wies f Zact+--+ f SOURS Ip Se 69 ap 
1 ¢ le pads 2 n—1 


Therefore, c,, > 0 for all n > 1. On the other hand, 


—_ In(n+1)+1 ae (ae 0 
n+1— &n = — Int? nn = = 0b S We 
aes 7 oe ihoe 1 ee 


Hence, {c,,} is a decreasing sequence that is bounded below by 0. By 


monotone convergence theorem, {c,,} converges to a limit y. This number 


n—-co 


il 1 
~y hina (1454-42 -Inn) 
Z n 


is called the Euler-Mascheroni constant, or simply as Euler’s constant. It is 


an important constant in mathematics. Numerically, it is equal to 
0.577215664901532 


correct to 15 decimal places. 


Now we return to the comparison test. Using Theorem 5.17, we obtain the 
following test for nonnegative series. 
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Theorem 5.20 Comparison Test 


Let Se Gy, and Ss b, be two series satisfying 


| tl 


0<a, <b, for all n > 1. 


(oe) [oe] 
EE DS b, is convergent, bs Gy, iS convergent. 


ni ‘cs 


2. If Ss Gy, 1s divergent, ys b, is divergent. 


a 1 


Reus ee Gn andt, = = +...+b, be respectively the n™ partial 
sums of the series os da, and Si by. Then {s,,} and {t,,} are increasing 


nl os 


sequences and 
Sa S thine 


Le lf S- b, is convergent, the sequence {t,,} is bounded above. Then the 


= 
oo 


sequence {s,,} is also bounded above. Hence, y Gp, 1S convergent. 


2 


2. If > dy, is divergent, the sequence {s,,} is not bounded above. Then the 


i=! 


[oe) 
sequence {t,,} is also not bounded above. Hence, b, is divergent. 


al 


Example 5.15 


Determine the convergence of the series 


loc) gn 
ore 


G1 
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Solution 
For n > 1, 


Therefore, 


Since the series 


= gn 


(oe) CO 
n=1 n=1 
is a geometric series with r = 2/3, it is convergent. By comparison test, 


the series S° al is convergent. 


Example 5.16 


Determine the convergence of the series 


CO 


n 


Solution 


For n > 1, 
1 


n n 
> = 5 
Ss 2/n 


Since the series == ve is a p-series with p = 1/2 < 1, it is divergent. 


So the series Ss = is also divergent. By comparison test, the series 
n 


oe) 


es is divergent. 
n/n+1 


In applying the comparison test, we need to identify the correct series to 
compare to, and prove some strict inequalities. In Example 5.15, we compare 
n 


i. = ——$= 16 = Bn” since 2” and 3” are the leading terms of the numerator 
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oe) n 


and the denominator of a,, when n is large. Since we know that the series > 3n 
n=1 
is convergent, we need to prove that a,, is up to a constant, less than or equal to 
(oe) 


b,, in order to use the comparison test to conclude that ‘3 Gy is convergent. 
n=1 
—" _ tob, = —“& since 
nfnt1l ” nn 
n and n,/n are respectively the leading terms of the numerator and denominator 
[oe] 


co 


Simiarly, for Example 5.16, we compare a, = 


of a,,. Since b,, is divergent, so we want to conclude that Gy, 18 divergent. 
g g 


n=1 n=1 


For this, we need to show that a,, is larger than a constant times b,,. 

Proving strict inequalities is tedious, and we see that it might not be necessary. 
In fact, we obtain the series to compare to by investigating the leading terms. 
This is somehow a limit. Hence, we can replace the comparison test by limit 


comparison test. 


Theorem 5.21 Limit Comparison Test 


[o-e) (oe) 
Given the two series 2 Gy, and De b,, that satisfy the following conditions. 


(tlt Ill 
(i) Gy > Oand b, > 0 foralln € Z. 


(ii) The limit L = lim “ exists and is finite. 


n—-co n 


Z a 
Since — > 0, we must have L > 0. 


n 


Co CO 
1. If L = O, and the series ye b, is convergent, then the series ye Gn 1S 


a! iu 
convergent. 


2. it £ >), the series ae Gy is convergent if and only if the series Ne Dp 


TT al 


is convergent. 


The condition (ii) says that when n is large, a,, is smaller than or equal to a 
multiple of b,,. 
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First consider the case where L = 0. By definition of limit with « = 1, 
there is a positive integer N such that for alln > N, 


Therefore, 
0 < an < by foralln > N. 
(oe) [o-e) 
Since the series SS b, 1s convergent, the series Se b, is convergent. Then 


mill n=N 
le) 


comparison test implies that the series S- Gy is convergent. Therefore, the 


n=N 
oo 


series y Gy, iS convergent. 
n=1 


Now for the case L > 0, take ¢ = L/2. There is a positive integer N such 
that for alln > N, 


This implies that 


1 19 
0< Fb, <a <b, foralln > N. 


co 
Comparison test then shows that the series Se Gn is convergent if and only 


ov 
ee) 


if the series SD b, is convergent. 


il 


Example 5.17 Example 5.15 Revisited 


=a considered in Example 5.15, we take a, = 


[oe) 
For the series » 


nm fale 
dg 
a 3n 
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n 


Pe 


CO gn CO 
Since the series y Bi is convergent, the series y 


n= n= 


is convergent. 


Example 5.18 Example 5.16 Revisited 


at n 
For the series —— considered in Example 5.16, we take a,, = 
d. nj/ntl £ 


1 
and b,, = —=. Then 


n 
n/n+1 vie 


co 
Since the series SS is divergent. 


1 uae n 
—— is divergent, the series —_——. 
“Jn = d, njyn+l 


n= 


Let us now turn to series that can have negative terms. First we formulate 
a Cauchy criterion for convergence of series. Recall that a sequence {s,,} is a 
Cauchy sequence if for every « > 0, there is a positive integer N so that for all 
m>n>QN, 


[Sm — Sn| < €. 


Applying the Cauchy criterion for convergence of sequences (see Theorem 1.43), 
and the fact that ifm > n> 1, 


8m — Sn—1 = An + An41 + +++ + am, 


we obtain the following Cauchy criterion for convergence of infinite series. 
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Theorem 5.22 Cauchy Criterion for Infinite Series 


co 


An infinite series Gy 1s convergent if and only if for every ¢ > O, there 
g y y 


n=1 
is a positive integer N such that for allm > n> N, 


lan eta] Gai a. 


Using this, we can prove the following. 


Theorem 5.23 


oe) (oe) 


If the series Sy |a,,| is convergent, then the series ye Gy iS convergent. 


wT! i=!) 


Given ¢ > 0, since the series y |a,| is convergent, there is a positive 


(p= 
integer NV such that for allm >n > N, 


Jan] + [ansal + +°* + [am] = []@n] + langal +++ + laml] < . 


By triangle inequaltiy, we find that form > n> N, 


|@n + Gnti t+°-+@m| < |@n| + longi] +---+ lam| < e. 


CO 


Using Cauchy criterion, we conclude that the series Gy iS convergent. 


(ll 


oe) 


The converse of Theorem 5.23 is not true. Namely, there exists series iS An 


n=1 
oo 


which is convergent but the corresponding absolute series S- |a,| is not convergent. 
n=1 


Therefore, let us make the following definitions. 
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Definition 5.4 Absolute Convergence and Conditional Convergence 


co 


Given that the series y Gy iS convergent. 


n=l 


oe) foe) 
1. We say that the series DE, a, converges absolutely if the series Sy |an| 


71 na! 


is convergent. 


(oe) 
2. We say that the series ye Gd, converges conditionally if the series 


il 


[o-e) 
|a,| 1s divergent. 


n=1 
Example 5.19 


=| ie 
( 2 converges absolutely. 


If p > 1, the series SS 
n 
n=1 


From the limit comparison test, we have the following. 


Theorem 5.24 Limit Comparison Test II 


(oe) co 


Given the series Se Gn, assume that there is a series 3 b,, such that b,, > 0 
m=1 I 
|an| 


for all n € Z, and the limit L = lim —— exists and is finite. If the series 


N—-Co n 


[o-@) [o.e) 
se b, is convergent, then the series Ms a, converges absolutely. 


fia) n=l 


Example 5.20 


Show that the series 


ar| 0” + 1 


is convergent. 
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Solution 


bn 
bee 


n 


Then b,, > 0 for all n € Z* and SS b, 1s convergent. Now, 


i! 


(oe) 


mye —1)"3" 
Therefore, the series y oil ae 
= 1 


PraeTl converges absolutely, and thus is 


convergent. 


To give an example of series that converges conditionally, let us discuss a 
convergence test for a special class of series called alternating series. 


Definition 5.5 Alternating Series 


A series of the form 


co 


So(-1)? thn = by — by + bg — bg +++ + Bona — Ban too, 


1 


where b,, > 0 for all n > 1, is called an alternating series. 


Example 5.21 


The series 


is an alternating series. 


A necessary condition for an alternating series So(-1)" "bn to be convergent 
n=1 
is lim b, = 0. The following theorem says that if {b,,} is also decreasing, then 


the alternating series is convergent. 
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Theorem 5.25 Alternating Series Test 


If {b,} is a monotonically decreasing sequence with lim b, = 0, the 
Nn—- Oo 


alternating series Solan, is convergent. 


call 


Since {b,,} decreases monotonically to 0, b, > 0 for alln € Zt. Let 


Gn = (—1)"~'b, be the n™ term of the series So(-1)" bn , and let s,, = 
n=1 


a, + ag +--++a, be the n™ partial sum. We are given that 


eee eee 


Therefore, 


Sond = Son—1 + Gan + Gong = Son—1 — (ban — don4i) < S2n-1, 


Sont2 = Son + Gonti + Gente = San + (bon+i — bento) = Son- 


This shows that {s2,_1} is a decreasing sequence and { 2, } is an increasing 
sequence. Since 


$2n = $2n-1 — bon, 


we find that 


So SS Sn SG Spo SS She 


Namely, the sequence {52,1} is bounded below by s2, while the sequence 
{San} is bounded above by s;. By the monotone convergence theorem, the 
limits 


S, = limi $5, 7 and s.=— lim So, 
nN Cco nN—- Oo 


exist. Since 


—bon = Q2n = $2n — $2n-1; 


taking the n — oo limits give 
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This proves that the sequence {s,,} has a limit s = s) = s,, and thus the 


(oe) 
alternating series So(-1)" ln is convergent. 


oll 


(oe) 
Notice that the sum of the alternating series s = So(-1)" "bn is the least 


n=1 


upper bound of {s2,,}, and the greatest lower bound of {52,_1}. 


Remark 5.2 Approximating the Sum of An Alternating Series 
If {b,,} is a sequence that decreases monotonically to 0, the alternating 


series So(-1) thn converges to a sum s. If 
n=1 


n 


Sy = 9 (—1)* 1b 


k=1 


is the n™ partial sum, then the error in approximating s by s,, is 


lo) 


s= = ye (1 be. 


k=n+1 


which is also an alternating series. From the proof of Theorem 5.25, we 


obtain a simple estimate 
|S — $n] < [bn4al. 


Example 5.22 


For the alternating series 


yo eS tol a 
Ta ee Oateon 4 


al 


1 
in Example 5.21, b,, = —. Since {b,,} decreases monotonically to 0, by the 
n 


alternating series test, the series 
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Se aves tol es 
Tou = 2 82003 4 


al 


co 


is convergent. Since the harmonic series y — is divergent, the series 
n 


a 


Glee 7 

y —— converges conditionally. 
n 

n=1 


Example 5.23 


For any 0 < p < 1, the sequence {1/n?} decreases to 0 montonically. 
ee i \ ca 
Hence, the alternating series ss ele 


: is convergent. Since the series 

n=1 

co oo = 

ieee (29-3 a 

y ak divergent, the series y ——~, — converges conditionally. 
n n 


n=) n=1 


Now we turn to two useful tests that are used for testing convergence of power 
series. They both based on comparisons with geometric series. We first prove the 
following. 


Theorem 5.26 
Let {a,,} be a sequence of positive numbers. Then 


ee bere : : a 
lim inf < liminf ’/a, < limsup ¢/a, < limsup sae 
nN—-0o 


N00 Qn 100 N—-00 An 


An+1 


: ee ner Qn+1 
Hence, if the limit lim —“* 
N00 Un, 


two limits are equal. 


exists, the limit lim 7/a,, also exists, and the 
noo 


Since a, > 0 forall n € Z*, all the four limits in the theorem are nonnegative. 


If {c,} is a sequence of postive numbers, it is easy to verify that 


su ee : inf le : 
P ey) Wintley | smsie 
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Therefore, if we prove that 


’ a 
lim sup ~/a, < lim sup cay 


n—0o n—00 an 


eer Se 
lim inf < liminf %/a,, 


n—co An n—0o 


follows by applying (5.2) to the reciprocal sequence {1/a,}. From 


Proposition 5.23, we have the inequality liminf ~/a, < limsup */ap. 
noo 


N—>0o 
Hence, we only need to prove (5.2). 


An+1 


If lim sup = oo, there is nothing to prove. Hence, we consider the 


n—0o an 
case 


‘ Gn+1 
u = lim sup —— 
n—>00 an 


is finite. Given ¢ > 0, there is a positive integer NV such that 


Se foralln > N. 
an 


By induction, we find that 
i Ste for alln > N. 
Let c= ay(u+e)—%. Then 
a, < 6!" (ue) for alln > N. 
This implies that 


lim sup ?/a, < limsupc!/"(u +e) = (u+e) lim cl” = (u+e). 


noo noo N—+00 
Since ¢ > 0 is arbitrary, we conclude that 


: : a 
lim sup ~/a, < u = limsup se 


n—>00 n—0o an 


This completes the proof of the theorem. 


Now we come to the proof of the root test. 
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Theorem 5.27 Root Test 


Co 
Given a series y Gn, let 


1 


p =limsup V/|ay|- 
Noo 


1. If p < 1, the series Ss Gd, converges absolutely. 


i=l 


2. If p > 1, the series ys Gy is divergent. 


cal 


3. If p = 1, the test is inconclusive. 


—_ 
If p < 1, takee = p 


integer NV such that 


in (b)(@) of Theorem 5.11. There is a positive 


V |@n| < pte =p for alln > N. 


Thus, we have 
fea ek for alln > N. 
Notice that 


UE ee 
= SS = 
2 


P1 1. 
Therefore, the geometric series ys pi is convergent. By comparison 


n— Ni 
oo lo) 


test, the series y |a,| is convergent. Thus, the series y Gy, converges 
m= n=1 


absolutely. 


1 
Ito 1 take] — y 5 in (b)@i) of Theorem 5.11. There are positive 
integers 21, 72,... such that 1 <n; < ng <...and 


een Ss pe for all k € Zt. 


Chapter 5. Infinite Series of Numbers and Infinite Products 393 


Thus, we have 
[colo for allk € Z*. 


Since 


1 


(= I 


9) ? 

and n, — oo as k > ov, we find that jim p>" = oo. In other words, the 
00 

sequence {/;"} is not bounded above. Eq. (5.3) then implies that {|a,,,|} 


is also not bounded above. Therefore, the limit lim a,, is not zero. Hence, 


Noo 
[o-e) 
the series y Gy, 1s divergent. 


n=1 
Now, let us look at some examples where p = 1. First, notice that 


] 
lim %/n = lim exp (=) = exp (im =<) =e =. (5.4) 
noo n—0o n mZ0o 


[o-e) 
: 1 
For the p-series y 5? On = n?. Thus, 
n 
i=il 


p= lim Vn-? = (Jim yn) =1. 


N—->Co N— oo 


But we have seen that the p-series is divergent if p < 1, and it is convergent 
when p > 1. This shows that the root test is conclusive when p = 1. 


Example 5.24 


[o.e) 1 _ n 

Determine the convergence of the series 2 (; = ‘ 
n 

ol 


Solution 
Applying root test, 


lim su | eae li ee J 
= = him a 
Cee ee Taal eh ed 


Since p < 1, we find that the series is convergent. 
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Finally, we have the ratio test. 


Theorem 5.28 Ratio Test 


lo) 


Given a series SS Ay With a, #4 0 for all n € Z*, let 


wl 


5 5 Qn+1 5 
e = limant : R= limsup 
n—r00 an n—0o An 


An+1 


1. If R < 1, the series = Gy, converges absolutely. 


a1 


2. Ifr > 1, the series ye Gy, is divergent. 


a1 


3. Ifr <1 < R, the test is inconclusive. 


If R < 1, Theorem 5.26 implies that p = limsup ¥/|a,| < 1. Theorem 
Noo 


5.27 implies that a Gy converges absolutely. 
n=1 


If r > 1, Theorem 5.26 implies that p = lim sup ¥/|a,,| > 1. Theorem 5.27 
OO 


CO 
implies that yy Gy 1s divergent. 


i= 


= 1 ee 
The p-series y — provides examples of r = R = 1, but the series is 
n 
n=1 


convergent if p > 1, divergent when p < 1. Hence, ratio test is also 


inconclusive when r < 1 < R. 


Ratio test is useful to determine the convergence of power series. We are going 
to study this in Chapter 6. 
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Example 5.25 


Determine whether the series is convergent. 


[oe) gn 
n-1 
(a) ae ama 


= peor 1 
(b) Dee! = 


Solution 


n 


2 
(a) Using ratio test with a,, = eo) era we find that 
n 


_ gntl 1 1 
p= ie te (222 |= thm pe A or Le 
nc} Gn, n>0n +2 De noon + 2 


lo) 
oye 
Therefore, the series y (-1)""! ry is divergent. 
n 


1 


iL 
(b) Using ratio test with a, = (yr, we find that 


; An+1 
pai = Tin |e 
n00] An, 


co 
1 
Therefore, the series So(- “a is convergent. 


(as) 


Convergence Tests 
In this section, we have explored various strategies to determine the 
[o-e) 


convergence of a series y Gn. We make a summary as follows. This is 


n=1 
a useful manual for beginners, but it is not binding. 


1. Check whether lim a,, is 0. If not, the series SS Gy is divergent. 
noo 


ya] 
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co 


co 
1 
. . . . n—-1 . oh 
. Check whether it is a geometric series y ar" ~ or a p-series y ae 


nll nl 


co 
A geometric series Ss ar" is convergent if and only if |r| < 1. A 


n= 


p-series y a is convergent if and only if p > 1. 
n 
n=1 


. If a, contains powers of n and functions such as In n, use integral test. 


. If a, involves only expressions of the form r” for more than one 7, do 


limit comparison test to compare with a geometric series. 


. If a, is a rational function of powers of n, do limit comparison test with 
a p-series. 


. For alternating series which does not converge absolutely, check whether 
alternating series test can be applied. 


. If a, = 6" for each n € Z*, and lim sup b,, exists, use root test. 
noo 


. If a, is a product of a rational function of powers of n and expressions 
of the form r”, use ratio test. 


Finally, we want to prove the following useful fact. 


Theorem 5.29 


Let r be a real number with |r| < 1. For any real number a, 


lim n°r” = 0. 
noo 


If r = 0, the limit is trivial. Hence, we consider the case |r| < 1 andr 4 0. 


If aw < 0, the statement is also easy to prove since lim r” = 0 and 
Noo 
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' if a < 0, 
lim n° = 
ee ifa=0. 


The highly nontrivial case is when a > 0. In this case, lim n“ = oo. Since 
N—-0o 


lk = Meh 


n*|r 
ye AN 

= 0 from lin — = 
x00 ev 


0. Nevertheless, let us present an alternative argument here which is 


| n 


and In|r| < 0, we can deduce that lim n°|r 
Roo, 


interesting by its own. 
co 


Consider the series S n*r” with a, = nr". When |r| < 1 andr 4 0, 


n= 


‘ ye fees 
Sunes rn (“+ ) =Iri (jim, “= ) = [eank 
An n—-0o n n->00 6N 


(oe) 


By ratio test, the series S- n“r”" is convergent. Therefore, 


yd 


Mine ae — 106 
nN Co noo 
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Exercises 5.2 
Question 1 


Determine whether the series 3 =a 


is convergent. 


Question 2 


co 
oe ; Inn, : 
Let p be a positive number. Show that the series y ae is convergent if 


n=1 


and only if p > 1. 


Question 3 


Let p be a positive number. Show that the series 


is convergent. 


Question 4 


Determine whether the series is convergent. 


Be WPA" 
(a) os Kn = zt 
‘») ol 2 + : +1 


Question 5 


Determine whether the series Si 


n=1 


is convergent. 


n—-1 Jn 
n+1 
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Question 6 


Determine whether the series is convergent. 


oe 


5n2 


oe 


Question 7 


Use Theorem 5.26 to determine 


lim Vnl!. 


n> Co 


Question 8 


Determine whether the series is convergent. 


o> (a) 
> Gare) 


Question 9 


Determine whether the series is convergent. 


(a) xe is — 


(b) xe 
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5.3 Rearrangement of Series 


In this section, we want to explore more about the difference between a series that 
converges absolutely and one that converges conditionally. 
[oe] 


Given a series > a, with terms {a,,}, define 


ii 
— |dn|+an J an, if a, > 0, 
"2 Yo, ita, 20 
_ |@nl —@n _ | Ons if a, <0, 

"2 Yo, if a, > 0. 


Then 0 < pp < |an|,0 < dn < |an|, and 


|@n| = Pn +n On = Ty, = Oe 
Example 5.26 


= n—-1 


(oe) 
For the series Sy, ( 


n= 1 


Theorem 5.30 


Let y Gd, be a convergent series. 


aaa 


1. If the series ye a, converges absolutely, then the series De Pn and the 


a! n—1 


CoO 
series ye Qn are convergent. 
nT 
[o) [o) 
2. If the series ae Gy, converges conditionally, then the series SS Dn and 


a! uc! 
ioe) 


the series ye dn are divergent. 


el) 
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First we show that the two series So Pn and Doe can only be both 
n=1 n=1 


convergent or both divergent. We have 


Pn = On + An, Gn = Pn — Gn, 


and we are given that the series y Gy is convergent. Therefore, the series 


(aah 


[o-e) (oe) 
Se Gn 1S convergent implies that the series SF Dn is convergent. Similarly, 


n=1 ss 


(oe) [o.e) 
the series ye Dn 1S convergent implies that the series dn 18 convergent. 


eel ii} 
oe) ioe) 


If the series y a, converges absolutely, the series y |a,| is convergent. 
: n=1 n=1 
Since 


es spre lan|, ES evel 
CO CO 


comparison test implies that the series SS Dn and S- dn are convergent. 


n=1 peas 
love) oo 


Conversely, if the series Ss Dn and De dn are convergent, since 


1 fpesuh 


lan| = Pn + Qn; 


(oe) Co 
the series Ss" |a,| must be convergent. Therefore, if the series ace 


so) n=1 
ioe) 


converges conditionally, which means the series y |a,,| is divergent, then 


asl 


[o-e) (oe) 
the series SS Dn and the series Sy dn Must be both divergent. 


n= 1 n=] 
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Example 5.27 


(= 1)! toi fl 
For the series ye ae =l1- 5 + 374 +--+ in Example 5.26, the 
n 


n= 
oo lo) 


= i = 1 
series = and the series a — are divergent. 
Yom Yon = Do 5, me der 


n=l n=1 n=1 


Definition 5.6 Rearrangement of a Series 


co co 
A rearrangement of a series 3 Ay, 1S the series SS An(n), Where 7 : Z* > 


n=1 (=I 


Z* is a bijective correspondence. 


Example 5.28 


Let 7 : Z* — Z be the bijective correspondence 


ifn = 3k —2, 
ifn =3k—1, 
ifn = 3k. 


= (—1)"-1 1 
The rearrangement of the series a ae a 3 ee ae 
(ll 


induced by 7 is 


foes ieee at 
3 2 5 7 4 , 


The main thing we want to discuss in this section is whether rearrangment 
will affect the convergence of a series. Consider the rearrangment discussed in 
Example 5.28, we know that original series 


—~ (=) fd 
Be 


n=1 n=1 


is convergent. We can find its sum in the following way. Let s,, = a,+a2+---+dn, 
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be its n™ partial sum. Then 


_ 11 1 1 il 
ae ae | m—-1 2n 
t,t 1 1 1 1 1 
Salhi =2 4 4Fo ers 
9°34 In—-1 ' 2n 2° 4 Qn 
2514 lp. i 1 jae re 
2 3 4 In-1 2n ) n 
2S 
7 k ko 
k=1 k=1 
Let 
= 
Cn =1l+i+...4+—-Inn= ——Inn 
n k 


By Example 5.14, lim c, = y is the Euler’s constant. We can write s2,, as 
noo 
Son = Con + In(2n) — (cn + INN) = Can — Cn + In2. 
Then we find that 


lim So, = lim (Con — Cn + In2) =y —yt+In2 =1n2. 
n—-> oo 


n—->co 


This shows that 


oo. = > — = In: 
n=1 n=1 


For the rearranged series 3 by = Ss n(n)» 
n=1 n=1 
1 1 


1 
b3p_9 = Ak — 3° b3p_4 = sk b3p, =—- for all k € Ts 


2k 


Let t, = b; + by +--+ +, be the n™ partial sum of the series > b,. Now 
n=1 
” 1 1 ae! 
= | -) =. 
: Vlas zi) De 5K 


k=1 k=1 


As k runs from 1 to n, 4k — 3 and 4k — 1 run through all positive odd integers 


between | and 4n. Therefore, 


; | n 1 Al 2n 1 n it 
= Dap am a De De 


k=1 
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Using c,, we can rewrite this as 


1 1 1 1 3 
t3n = Can tln(4n)— 5 (Con + In(2n))— ; (Cn + Inn) = Can — oon aout 5 In 2. 
This allows us to conclude that 
im tan = 5 In 2. 
Since 
tgn41 = tan + O3n41, t3n42 = tgnsi + b3ngi + b3n42; 
and lim b,, = 0, we find that 
noo 

lim t3n+41 = lim t3n+2 = lim t3n- 

n—-0o noo N+ 0o 
This proves that the series ee b, is convergent, and it converges to lim t3, = 

noo 
n=1 

3 
—In2. 
2 


[o-e) (oe) 
Hence, although the series ys b, is a rearrangement of the series S° An, it 


n=1 n=1 


has a different sum. 
In the following, we prove that rearrangement of a nonnegative series would 
not lead to different sums. 


Lemma 5.31 


oe) 


If a, > 0 for all n € Z* and the series eS Gy, iS convergent, then any 


i! 


rearrangement of the series has the same sum. Namely, for any bijecion 


gr: Zt 3Z, 
es An(n) = ye An. 
ill n=1 
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In a nutshell, this is just the fact that a nonnegative series is convergent if 

and only if the sequence of partial sums is bounded above, and the sum of 

the series is the least upper bound of the sequence of partial sums. 

For a rigorous argument, define s,, = a,+---+a,, to be the n™ partial sum of 
lo-e) 


the series ye An, aNd ty = Ax(1) +++ + +Aq(n) to be the n partial sum of the 


n=l 


co 
series SS x(n). Notice that both {s,,} and {t,,} are increasing sequences. 
n=1 


We are given that s = sup{s,,} exists. For any positive integer n, the 
set {7(1), 7(2),...,7(m)} has a maximum N,,. This means that the set 
{m(1),7(2),...,7(n)} is contained in the set {1,2,...,N,,}. Therefore, 


Us SS Chg Se 


This shows that the increasing sequence {t,} is bounded above by s. 
Hence, t = lim t,, = sup{t,} exists andt < s. For the opposite inequality, 
Noo 


[oe) lo) 
observe that S- Gy 1S a rearrangement of Sy x(n) induced by the bijection 
Il n=1 


nm! : Z* —» Z*. Hence, the same argument above shows that s < t. 
Combine together, we have t = s, thus proving that any rearrangement of 
[o-e) 


the series y Gn has the same sum. 


a1 


Now we can prove that any rearrangemnt of an absolutely convergent series 


converge to the same sum. 


Theorem 5.32 Rearrangement of Absolutely Convergent Series 


co 
If the series SS Gd, converges absolutely, then any rearrangement of the 


ll 


series has the same sum. Namely, for any bijecion 7 : Z* > Zr, 


(oe) 


i x(n) = SS An- 
n=1 


1 
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Define the nonnegative series SS Dn and se dn by 


alk (‘pal 
|Qn| + Gn lan| — Gn 
Pn = ’ Q. : 
2 2 
Then 
On = Pn — An- 


Since the series SS Gy, converges absolutely, Theorem 5.30 says that the 


ie 


[o-@) CO 
series y Dn and y dn are convergent. 


n=1 — 


Lemma 5.31 says that for any bijecion 7 : Z* — Z", the series ye joe 


n=) 


and De On(n) are convergent, and 


alll 


S- Pr(n) = See Ske: = Se 
n=1 n=l ple n=l 


lo) 


Therefore, the series Sy n(n) 1S convergent and 


i—1 


3 Ax(n) = S > Pr(n) ey Whe a Ee iam Dea = Sy the 
n=1 m=1 (o=t (=I nr m= 


Finally, we come to the celebrated Riemann’s theorem for series that converges 
conditionally. 
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Theorem 5.33 
Riemann’s Theorem for Conditionally Convergent Series 


(oe) 
Let De Gy, be a series that converges conditionally, and let b and c be two 


nl 


extended real numbers with b < c. There exists a bijection 7 : Z* — Zt 


such that for the series Se y(n) With partial sums t,, = Gq(1) + +++ + Ax(n), 
n=1 


linn at ¢,, — 0, lnmnsup tt, —-c. 
n—70o n—>00 


Here an extended real number is either an ordinary real number or too. This 
theorem implies that one can have a rearrangement of a conditionally convergent 


series that diverge to +00 or converge to any real number. 


For n € Z™, let 


= |an| + Qn = lan| — Gn 
Pn — i at Seen 
co 


Since the series ys Gd, converges conditionally, Theorem 5.30 says that the 


n=l 


series Dn and S- dn are divergent. Let 


n=1 n=1 
ce —(weZ! a, 20). So —{weZ |a,<0\- 
Then 
SUL Se, Seno — Vv: 


There are strictly increasing maps 7, : Zt + Zt and 72: Z* > Z*, such 
that 7 ( 2) = Sisandrs( 29) = 5 


[o.@) [o.@) 
Define the nonnegative series De Un and ey Un by 


nl i! 


Un = An1(n), has cas 
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Then the sequences {u,,} and {v,,} are obtained from the sequences {p,,} 


and {q,,} by removing some zero terms. Hence, both nonnegative series 
(oe) (oe) 


Se Un and es Un are divergent. 


na) n=2 


Now we start to define the bijection s : Z* —> Z*. Construct two 
sequences of real numbers {b,,} and {c,,} such that c; > 0, bp, < c, for 
alln € Zt, and 


lim a0 0 in ¢, =¢é 
n—- Ooo nN—- Oo 


Take k, to be the smallest positive integer such that 
Ci =U ar Uy ap eee ap Ue, => Cle 


Then define 
m(1) = m(1), asana panhan = ™1(k1). 


Take /, to be the smallest positive integer such that 
By = Cy — (up tue +--+ + u,) < b1. 
Then define 
w(ky +1) = m9(1),...,7(ki +h) = mo(hh). 
Take kz to be the smallest positive integer such that 
Op dea i eit Uae ee 
Then define 
w(ky +1, +1) = mi (ki +1),...,0(Ai th + ke) = a1 (ky + ke). 


Take / to be the smallest positive integer such that 


Ba Co (Uap 1 oe Ope eee Uae 
Then define 


Wwe tice ce oe =o Uiear sie ae eee ote) == ies ae (oy) 
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[o-e) [o.e) 
Continue this construction inductively. Since y Un and y Un are 
n=1 n=1 


nonnegative sequences that diverges to oo, and b,, ae Cm for all positive 
integers m, the existence of the positive integers k,,, and l,, at each step is 
guaranteed. It is easy to see that the map 7 : Z* —> Z* is a bijection. For 


the series Se Qninys 1El ty = Gna) + -°- + Aa) be its n® partial sum. Set 


7h 
Qo = Po = 0, and for m > 1, let 


Am = ky + ko +--+ +km, Belge ae eee 
Ona ae Gpae ea ues MG = Oh op igs SS 6R Roe bes 


l<ay<ag<+++-<Qm<---, 
SSE BSG bh Se ECG, sa ey 


SG ee Oo ee Or es 
By construction, 


Hee a eee 

Ue by Mere 2h ee ee cree eerie Di nines Ua Oa 
On eee er 
Uae Ue apy pee tee oe et Une ae 


(oe) 


Since the series ye dy 1s convergent, lim a, = 0. This implies that the 
NOOO 


n=1 
sequences {u,,} and {v,,} converge to 0. Therefore, 


[ings — tie a 
m—-oco m—- co 
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Given < > 0, there exists a positive integer //, so that for allm > M,, 


SI & 
O0<Ue, <= O< tha, <= 
—_— am De > “Bm 2 


There exists a positive integer W/, so that My > M, and for all m > Mo, 


iS (e 
bm > b- =, rec =. 
5 Cc Ot 5 


Vet max ain Onmeney. tl = V, theny = Ny, > On. Hence, 
there exists m > Mp such that 


One at Ore 
Then 
Pip SUMS, AE Dy aC eeut ab Ui et 
Since m > Mo, Cm and Cm41 are less than c + ¢/2. Sincem > Mz > Mi, 
Uom and Ug,,,, are less than ¢/2. These imply that for all n > N, 


bay SCoPE. 


Hence, 


lim sup ty, < ¢. 
n—- Ooo 


Similarly, we can show that 


liminft,, > b. 


noo 
For all m € Z*, 
Crear) pam Omran Ones Ca ns See ae 


Taking m — oo limits show that {t),,} is a subsequence of {t,,} that 
converges to b, and {t;,,} is a subseqeunce of {t,,} that converges to c. 
This completes the proof that 


hiint ee, hincup i, — c: 
729) n—0o 
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Exercises 5.3 


Question 1 


Show that the series 


is convergent. If 7 : Zt > ZT is a bijective correspondence, consider 


the rearrangement of the series se Gy given by SS Ar(n)- Does the series 


y=! ia!) 
ioe) ee 


> n(n) Necessarily converge to the same number as the series Ss An? 
nk n=1 
Question 2 


Show that the series 


yma >! oe 


iL 


is convergent. If 7 : Zt > Zr is a bijective correspondence, consider 


the rearrangement of the series 3 Gy, given by s x(n). Does the series 


n=1 n=1 
oo oo 


Ss n(n) Necessarily converge to the same number as the series » An? 


i=) c=" 
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Question 3 


Show that the series 


hai (ah a 
2 a 


(cl 


is convergent. If 7 : Zt — Z? is a bijective correspondence, consider 


(oe) (oe) 


the rearrangement of the series Ss Gy, given by se n(n). Does the series 


nN n=1 
oe) lo) 


> Ar(n) necessarily converge to the same number as the series we An? 


(=) n=1 
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5.4 Infinite Products 


In this section, we consider infinite products and study its convergence. An infinite 


product is a product of the form 


oo 
[] um = uitia-+ uns, 
n=1 


where {u,,} is an infinite sequence. The definition of convergence of infinite 
product is slightly more complicated. 


Definition 5.7 Convergence of Infinite Product 


(oe) 
Given a sequence {u,,}, consider the infinite product I] Ue 


n=1 
(a) If infinitely many of the terms wu,,’s are zero, then we say that the infinite 
[o-e) 


product I] Un 18 divergent. 
n=1 
(b) If only finitely many of the u,,’s are zero, there is a positive integer @ 
such that u,, is nonzero for all n > @. Form the partial product 


el [[. forn > £. 
k=e 


(i) If the limit tim P|], does not exist or the limit is 0, we say that 
the infinite product Il Un is divergent. 
n=1 
(ii) If the limit tim P{€], exists and is equal to a nonzero number 
P|¢], we say that the infinite product II Un converges to 


iL 


The convergence of infinite product is not affected by finitely many terms 
in the product. If u, € 0 for all n > 1, we will denote the partial product 
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Pill = II uz simply as P,,. 
k=1 


(oe) 
By definition, if the infinite product II Un converges to 0, then at least one 


(oll 
of the wu, is equal to 0, and there are only finitely many of the w,,’s that are 
equal to 0. 


Let us look at a few examples. 


Example 5.29 


7 1 
Determine the convergence of the infinite product II (1 =F “| : 
n 


p= 


Solution 


1 
Forn > 1, u, = 1+ — £0. Notice that 
n 


(oe) 

i, 

Since lim P, = oo, the infinite product II (1 a. =| is divergent. 
n—-co er n 


Example 5.30 


(oe) 
Determine the convergence of the infinite product II (1 == 


n= 
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Solution 


it 
For n > 1, u, = 1— —. We find that wu; = 0 and u,, > O for all n > 2. 
n 


P2|n = II (1 = 


k—2 


= 1 
Since lim P[2],, = 0, the infinite product I] (1 — =| is divergent. 


Example 5.31 


(oe) 
Determine the convergence of the infinite product I] (1 == 
n 


R= 


Solution 


ee) ==) es) 


3 n+1 n+1 
Xo xX = P 
n 2 n 2n 


ree ete 7 
Since ?|2| — Jim Pa = Re the infinite product Il 


convergent, and it converges to u; P[2] = 0. 


When the sequence of partial products {P,,} converges to 0, we consider 


co 
the infinite product as divergent. This is so that the infinite product I] On 


n=l 
lo) 


is convergent if and only if the infinite product I] u,,’ is convergent. 


71 


The following is obvious. 
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Proposition 5.34 


[oe) 
If the infinite product I] Un is convergent, then lim u, = 1. 
nN—- Oo 


n=l 


Using this proposition, when we consider convergence of the infinite product 
[oe) 
I] Un, We can assume that u,, > 0 for all n € Z*. 


n=. 


There is a Cauchy criterion for convergence of infinite product. 


Theorem 5.35 Cauchy Criterion for Infinite Product 


(oe) 


Let {u,,} be a sequence of positive numbers. The infinite profuct I] Un is 


n=1 
convergent if and only if it satifies the Cauchy criterion, which says that for 
every € > 0, there exists a positive integer N such that for allm > n > N, 


Tt] - 25 


The proof of this is more complicated than its infinite series counterpart. 


Lee = I] ux be the n™ partial product. Then P,, > 0 for all n € Z*. If 


k=1 
co 


the infinite product I] Un is convergent, then the sequence { P,,} converges 


n=l 
to a positive number P. This implies that there is a positive integer N, such 
that 


Ie 
iS i for alln > Nj. 


Given € > 0, apply Cauchy criterion to the convergent sequence { P,,}, we 
find that there is a positive integer Ny such that for all m > n > No, 


P 
ie Ie |= = 


Chapter 5. Infinite Series of Numbers and Infinite Products 417 


Let N = max{ Nj, No} + 1. We find that for allm >n > N, 


Therefore, the Cauchy criterion for infinite product is satisfied. 
Conversely, assume the Cauchy criterion for infinite product holds. Taking 
€ = 1/2, we find that there is an integer N, such that for all m > n> Ni, 


This implies that 
3 
< 5 for all n > Nj. (5.5) 


Now givene > 0, there is aninteger NV > Nj, such that for allm > n > N, 


Il up| —1| < as 
as, 


k=n+1 


This implies that when m > n > N, 


[P= j= ||| || 2 


k=n+1 


< 


ue 3P. 2 
2 My a 


ye a 


Hence, { P,,} is a Cauchy sequence, and thus it is convergent. Eq. (5.5) then 
implies that 

1 
Wiiaal Pe 5M S10; 


n—->co 


This proves that {P,,} does not converge to 0. Therefore, the infinite 


product I] Un is convergent. 


nl 


Chapter 5. Infinite Series of Numbers and Infinite Products 418 


The following gives a relation between the convergence of the infinite product 
with the convergence of infinite series. 


Theorem 5.36 


Let {u,,} be a sequence of positive numbers. Then the infinite product 
co 


co 


I] Un 1S convergent if and only if the infinite series De In uy, 18 convergent. 


it! n=! 


(oe) 


First assume that the infinite product I] Ux 1S convergent. Given € > 0, 
k=1 
since lim Ina = 0, there exists a 6 such that 0 < 6 < landif |x —1| < 0, 
eat 


then |Inz| < e. By the Cauchy criterion for infinite products, there is a 


positive integer N such that for allm > n> JN, 


Tr =i 


It follows that for allm > n> N, 


m 


Snug = | Tl vl <€, 
k= 


k= 


co 


This proves that the infinite series Sy Inu, satisfies the Cauchy criterion. 
n=l1 


Hence, it is convergent. 


co 


Conversely, assume that the infinite series S- Inu, 18 convergent. Given 


n=1 
€ > 0, since lim e” = 1, there exists 6 > 0 such that if |x| < 6, then 
x 


le7—1] <e. 
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Using Cauchy criterion for infinite series, we find that there is a positive 
integer NV such that for allm > n> N, 


Sy Uk) <0. 
cr 


It follows that for allim > n> N, 


ft] - =f ($s) <« 


= 


lo) 
This shows that the infinite product I] Un Satisfies the Cauchy criterion. 


n=1 
Hence, it is convergent. 


Example 5.32 


co 
; : a\ ., 
For any nonzero real number a, the infinite product I] exp (=) is 
n 
n=l 


co 
: : See : Qa. 8 : ee 
divergent since the infinite series y — is divergent; while the infinite 
n 


product I] exp (<) is convergent since the infinite series y = 5 
n n 
oc n=1 
convergent. 
_ Infl+a ee 
Since lim ae) = |, it is natural to compare the convergence of the 
a> a 


product [[c + d,) to the convergence of the series > ips 


n=1 n=1 
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Theorem 5.37 


Let {a,,} be a sequence of real numbers such that 0 < a, < 1 for all 
n € Z*. Then the following three statements are equivalent. 


co 


(a) The series SS Gy 1S convergent. 


eal 


(b) The infinite product [[a + Gy) is convergent. 
n=1 


(c) The infinite product [[c — dy) is convergent. 


pl 


Since 0 < a, < 1 forall n € Zr", we find that 1+ a, > 0and1—a, > 0 


for alln € Z*. A necessary condition for the convergence of either Sy Gn 


n=l 


or Ila + Gp), OF Ila — Gn), is 
n=1 n=1 


hint. 0) 

n—-co 
Vv 
By Theorem 5.36, it is then sufficient to prove that if {a,,} is a sequence of 
real numbers satisfying 0 < a, < 1 forall n > 1, and lim a, = 0, then 


n—-co 


the following three statements are equivalent. 


(oe) 


(a) The series 3 Gy, is convergent. 


i! 


(b’) The series S- In(1 + a,) is convergent. 
n=1 
(c’) The series SS In(1 — a,) is convergent. 


n=l 
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Let b,, = In(1 + a,) and c,, = — In(1 — a,,). Notice that b,, and c,, are also 
positive numbers. 


Now since the sequence {a,,} converges to 0, we find that 


By limit comparison test for positive series, we find that Dae iS 


n— | 
lo) lo) 


convergent if and only if SS b, is convergent, and S- Gy, iS convergent 


=) a1 
lo) 


if and only if ye Cn is convergent. These establish the equivalence of (a) 


nal 


and (b’), and the equivalence of (a) and (c’). 


Example 5.33 


Theorem 5.37 can be used to deduce the following. 


= 1 
1. The infinite product I] (1 a ~ | considered in Example 5.29 is 
n 


n=) 
lo) 


divergent since the infinite series s, — is divergent. 
n 


all 


5 1 
2. The infinite product I] (1 = =| considered in Example 5.30 is 
n 


i! 


[o.@) 
divergent since the infinite series y — is divergent. 
n 


al 
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~ i 
3. The infinite product I] (1 = =) considered in Example 5.31 is 
n 


ll 
le) 


convergent since the infinite series y —, 1s convergent. 
n 


oI) 


Theorem 5.38 


If the infinite product [[a + |a,,|) is convergent, then the infinite product 


i=! 
lo) 


[[¢ + dy) is convergent. 


n=] 


Without loss of generality, we can assume that |a,,| < 1 for all n > 1. 
Given < > 0, since the infinite product [[a + |a,,|) is convergent, Cauchy 
n=1 
criterion says that there is a positive integer NV such that for allm > n > N, 
Tas lie) | ll ee 
k=n 


By an inequality in the exercises, we find that 


Ta +00 = s [] (+ las!) -3 neces 


k=n kk 


[o-e) 

This proves that the infinite product [[a + dy) satisfies the Cauchy 
n=1 

criterion. Hence, it is convergent. 
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Definition 5.8 Absolutely Convergent Infinite Products 


We say that the infinite product I] (1 +a,,) converges absolutely if the 


Il 


infinite product I] (1 + |a,|) is convergent. 


n=l 


Theorem 5.38 says that an absolutely convergent infinite product is convergent. 


Corollary 5.39 


co 
Let a a, be a series that converges absolutely. Then the infinite product 


peal) 


I] (1 + a,) converges absolutely. 
i=l 


Since SS a, converges absolutely, lim a, = 0. Without loss of generality, 
nN Cco 


dl 
oo 


we can assume that |a,,| < 1 for alln > 1. Since Se |a,| is convergent, 


au) 
oo 


Theorem 5.37 implies that the infinite product I] (1 + |a,,|) is convergent. 


ow 
lo) 


Theorem 5.38 then implies that the infinite product I] (1 + a,) converges 


i) 


absolutely. 


Example 5.34 


ee =] \r=! 
The infinite product I] (1 == ( } ) is convergent since the series 
n 


=) 


Sian 
S- "2 converges absolutely. 
iil 


Now it is natural to ask the following question. Is it true that the infinite 
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(oe) (oe) 
product [[a + Gn) is convergent if and only if the series S$ Gy 1S convergent? 
n=1 


n=1 
The following two examples show that neither one implies the other. 


Example 5.35 


Let {a,,} be the sequence defined by 


1 
Aon = — forn > 1. 


Q2n-1 = ) 
pica ea Viel 


and so, = O for all n > 1. This 


1 
JVJn+1 


implies that the series se Gy, converges to 0. 


nl 


n 
If s, = ) dy, then son) = 
k= 
[o-e) 


n 


On the other hand, if P, = | [(1 + ax), we find that 
p= 


n 1 il n+l 1 
pep = a eo i Ne 
moa [1 (1-7) (t+a55), P= TT (1-5) 


— i 
Since the infinite product I] (1 — “| is divergent, the infinite product 
n 


n= 


[[a + dy) is divergent. 
=I 


co co 
This gives an example where Sah is convergent but [[a + Gn) is 
j=l) 1 


divergent. 


Chapter 5. Infinite Series of Numbers and Infinite Products 425 


Example 5.36 
Let {a,,} be the sequence defined by 


1 — 


Op = = yy = SES sy 
Vn’ 


1 
ie = IIc + ax), we find that Py,-1 = a 


co 


and P>,, = 1 for all 


n => 1. Hence, the infinite product [[¢ + Gn) converges to 1. 


1 


ie, = S- dz, then 


n 


ee le 7a Lao 


1 
Compare to the series , we find that the series 
Le Esa) «VER +1) 


divergent. Therefore, lim s2,, = oo, which implies a lim s,, does not 
noo noo 
co 
exist. Hence, the series y Gy is divergent. 


al 


This gives an example where [[a + Qn) is convergent but a4 is 
n=1 =k 


divergent. 
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Exercises 5.4 


Question 1 


Given that {a,,} is a sequence of numbers with a, > —1 for all n € Zt. 
Prove that for alln € Z*, 


Question 2 


co 
Let s be a positive number. Show that the infinite product II 


n=2 


convergent if and only if s > 1. 


Question 3 


For n > 1, let 


Show that the infinite product II Un 1S convergent and find its value. 


n=1 
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5.5 Double Sequences and Double Series 


In this section, we give a brief discussion about double sequences. 


Definition 5.9 Double Sequences 


A double sequence is a function f : Zt x Z* — R that is defined on the 


set Zt x Z*. It is customary to denote a general term f(m, 7) as Qmn, and 
denote the double sequence by {f(m,7)} 7 ,=1 OF {@mn}ren=t 


The following gives some examples of double sequences. 


Example 5.37 


oe 


min a 1) m,n=1 


es 
© lara 


et 


Definition 5.10 Convergence of Double Sequence 


We say that a double sequence (Ginn | converges to a number a, 


written as 


Q=— ‘hima... 
m,n—0o : 


provided that for every ¢ > 0, there is a positive integer N so that for all 
positive integers m and n withm > N,n => N, 


lamn — a| <e. 


If a double sequence converges to a number a, this number a is unique, and 
we say that the sequence is convergent. Otherwise, we say that the sequence is 
divergent. 
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Example 5.38 


For the double sequence { 


considered in Example 5.37, 
m nal 


notice that 


n(m + 1) i il i 1 1 
ioe = SS 1+ —]=1- a ; 
”" m(n + 1) Moe I m nt+1om m(n+1) 
Given < > 0, there is a positive integer N so that 3/N < ¢«. Thenifm > N, 
n>QN, 


ee 1 ee 
m m(n+1) N 


eee 
ory 


Gane a 


This proves that 


n(m + 1) 


(oe) 
mn 
Before we study the convergence of the double sequence 4 —,——, ; 
m? +n m,n=1 


let us prove the following lemma, which says that for a double sequence {@mn} 7. n=1 
to be convergent, it should approach the same limit regardless of how m and n 
goes to infinity. 


Lemma 5.40 


Let {4m,n}%> n=1 be a double sequence that converges to a number a, and let 
g: Z* - Z* bea function such that Jim g(n) = oo. Define the sequence 
{on }rda by 

Os eye 


Then the sequence {b,,}°°, also converges to a. 


Notice that {g(n)} is a sequence of positive integers that diverges to oo. 
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Given < > 0, there is a positive integer N, such that for all (m,n) € Z* x 
ie with m > Ni and n > Ni, 


lam — al <e. 


Since lim g(n) = o«, there is a positive integer N > N, such that g(n) > 
n-co 
N, for alln > N. Ifn > N, g(n) > N, and n > N,. Therefore, 


(Cl eee ol 


This proves that the sequence {b,,}°°., converges to a. 


Example 5.39 


For the double sequence eee considered in Example 5.37, 
Giue E10? 


assume that it converges to a. Take g; : Zt — Z* to be the function 
gi(n) =n. Then we find that 


mn 


n? 1 
St oan? 7 
Take g2 : Z* — Z* to be the function g2(n) = 2n. Then we find that 


ki Qn? 2) 
o = hin ———— = = 
no An? +n? 5 


We get two different values of a. This is a contradiction. Therefore, the 


mn a 
double sequence « —_——— is divergent. 
d { m2 +n? \ g 


mi 


It is easy to prove that linearity also holds for limits of double sequences. 
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Proposition 5.41 Linearity 


Assume that the double sequences {dmn}%n—1 ANd {Dmn}Pnai are 
convergent. Then for any constants a and (3, the double sequence 


co 
her. ae Oat en 
is also convergent, and 


lime (Gra + Onn) =o lim a, -- 6 lim 0.5. 
m,n—-oo m,n—-oo m,n—oo 


Leta= lim an, andb= lim b,». Givene > 0, there are positive 


m,n—-oo m,n—-oo 


integers NV, and Np» such that 


l@mn — | < 5 for all m > Ni,n > N,; 


ae 
(la| +1)’ 


lBmnn — b| < 5 for all m > No,n > No. 


E 

([8] + 1)” 
Let N = max{ Nj, No}. For all positive integers m and n with m > N and 
n > N, we have 


|(QGm,n ar Bona) = (O80) [Oe Gree =| ce [2 ||bmn =] 
la| || 


<< Esp E 
2(\a\=- 21/8/41) 
Ee € 
<i=+-7-=6 


Pi? 


This proves the assertion. 


In the proof, we divide ¢/2 by |a| + 1 instead of |a|, because a can be 0. 
For the double sequence we considered in Example 5.38, notice that 


1 
lim (im oS) ee Gy CY 


The question is whether we can find the limit of a double seqeunce {a} by 
taking the limit n — oo first, and then take the limit m — ov, or in the opposite 


order. 
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(oe) 
mn . 
For the double sequence ¢ —_——~ , for fixed m > 1, taking the n > 
m? 5 n? mn=1 
oo limit, we have 
; mn 
lim ————~ = 
noo m2 +n? 
Hence, 
‘ : mn 
lim ( lim ad = 
moo \ noo m? + n2 
mn 7 a 
But we have shown that the double sequence » —,——, is divergent. 
me+n Tmn=1 


Therefore, we find that to study the limit of a double sequence, in general we 
cannot take one limit first before the other. The following theorem says that if one 
knows apriori that the double sequence is convergent, one can take iterated limits 
under some conditions. 


Theorem 5.42 


Assume that the double sequence {@m,n}%, converges to a, and for each 
m € Z*, the limit 


O.. = Ita Gen 
noo : 


exists. Then the sequence {b,,,} also converges to a. In other words, 


ine — (———- lim (Jim ore — 0) 
m,n—0o : m—oo \n—00 


provided that the limit lim a,,,, exists for allm € Z*. 
n—- oo 


Given < > 0, there exists a positive integer NV such that for all (m,n) € 
Z* x Zt withm > N andn > N, 

E 

la@mn — al < a 


Hence, for fixed m > N, taking the n — oo limit gives 


& 
lbm — a] S 5 <e. 


This proves that lim b,, = a. 
Noo 
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The assumption that the limit lim a,,, exists for each m € Z* in Theorem 
nN—- Oo 
5.42 is needed, as the convergence of the double sequence {@mn}%, does not 
guarantee that the limit lim a,,,,, exists. An example is shown below. 
N—-0o 


Example 5.40 
Consider the double sequence {Ginn}? n—1 With 


Pela 


Amn 


For fixed m € Z*, the sequence { a | does not have a limit 


n—1 


iL 


: aia nae m+ 1 

since it is oscillating between 5 and 5 But the double sequence 
m m 

{Omn}rn=1 converges to zero. This can be proved in the following way. 


i, aL mae 
Given « > 0, since lim ——— = 0, there exists a positive integer N so 
mo mM 


that for alli > N. 


This implies that ifm > N,n > N, then 


m+1 
VSG S nee: 
m 


Hence, the double sequence {dmn}7n=1 Converges to zero. 


Definition 5.11 Bounded Double Sequence 
We say that a double sequence {am,n}7°,-1 is bounded if the set 
lGiren | (m,n) € Zt x Zt} 


is bounded. 
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Remark 5.3 


If a double sequence {@mn}-n=1 1S convergent, it is not necessarily 
bounded. For example, consider the double sequence {@mn}7n—1 With 


fie — i 


1, if 7 > 2. 


aman = 


Obviously, it is not bounded. However, It is not difficult to prove that the 
double sequence {4mn}7n=1 converges to 1. 


Definition 5.12 Increasing Double Sequence 


We say that a double sequence {amn}7 ,=1 iS increasing in both indices 


provided that for fixed m € Z*, {a }°2, is an increasing sequence in 7; 


and for fixed n € Z*, {dm ,}%_, is an increasing sequence in m. 


If a double sequence {a@,,,,}°,,_, is increasing in both indices, for any positive 


integers 1, 772,71, N2, if Mz > m, and nz > nj, then 


Onisha < Grinds 
* 9 


Figure 5.2: An illiustration of the relative positions of (m1, 71) and (m2, n2) when 


Mz > M4 and ne > N4. 
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Example 5.41 


The double sequence {@mn}7° ,=1 With 


(m+ 1)(n+1) 


amn = 


is increasing in both indices. 


The following is a counterpart of monotone convergence theorem for double 
sequences. 


Theorem 5.43 Convergence of Increasing Double Sequences 


Let {@mn}?n=1 be a double sequence that is increasing in both indices. 
Then the double sequence {m,n }?.,=1 iS convergent if and only if it is 


bounded above. In case it is convergent, itconvergesto sup {Gm n}. 
(m,n)EZt xZ+ 


If the sequence {dn}? n=1 Converges to a, then there is a positive integer 
N such that for all (m,n) € Zt x Zt withm > N andn > N, 


Gren al 1 
This implies that 


Gre aa +l forall je No AN 


Given (m,n) € Z* x Zt, letk = max{m,n, N}. Thenk > m, k > nand 
k > N. Therefore, 


eS he nS Ip 
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This prove that the double sequence {Gm}? ,=1 is bounded above by a+1. 


In fact, the same reasoning shows that it is bounded above by a + ¢ for any 
€ > 0, but we do not need this. 
Conversely, if {@imn}?xn—1 18 bounded above, then 


= Supe Grnnt 
(m,n)EZt x Zt 


exists. Given ¢ > 0, there exists (™mo,o) € Z* x Z* such that 
Onyng 2G — e: 
Take N = max{mo, no}. Thenifm > N > m,n >N > no, 


Pipe tira TO et 


By definition a, < a. Therefore, for all (m,n) € Zt x Zt with m > N 
and n > N, we have 


lamn — a| < €. 


This proves that the double sequence {@mn}%,-1 iS convergent and it 


convergestoa= sup {dm }. 
(m,n)EZ+ x Zt 


Now we turn to double series. A double series is a series of the form 


y Am,ns 


(m,n)EZt x Z+ 


where {@mn}?..n=1 iS a double sequence. For each (m,n) € Z* x Z*, we define 
the (m,n) partial sum s,,,, by 


m n 
Smn = Y Y Qk,I- 


k=1 [=1 
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Definition 5.13 Convergence of Double Series 


We say that the double series SS Amn 18 Convergent provided that 
(m,n)EZ+ x Zt 
the double sequence of partial sums {s,,,,,} is convergent. In this case, the 


sum of the double series is 


Therefore, 
m 
Sm,n — Smn—1 — Sm—1,n =p Sm—-1,n—-1 = S- Qkyn — Akn = am,n- 
k=1 k=1 
From this, we obtain the following immediately. 
Proposition 5.44 
If the double series SS. GQmn 18 convergent, then the double 


(m,n)EZt xZt 
sequence {@m,n}>y n—1 converges to 0. 


If S- Amn is a double series with a,,,, > 0 for all (m,n) € Zt x 
(m,n)EZt x Zt 
Z*, then the double sequence of partial sums {,,,,,} is a double sequence that is 


increasing in both indices. From Theorem 5.43, we obtain the following. 
Theorem 5.45 


If Ss Amn is a double series with a, > 0 for all (m,n) € Z* x 
(m,n)EZ+ x Zt 
Z*, then it is convergent if and only if the double sequence of partial sums 


{Sm,n} is bounded above. 
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Figure 5.3: An illiustration of those terms a;,; that involved in $5. — Smiyn1 


when my > mj, and ng > nj. 


Corollary 5.46 


If S- Amn is a double series with a, > 0 for all (m,n) € Z* x 
(m,n)EZ+ x Zt 
Z*, then it is convergent if and only if the sequence {s,,,, }°2., is convergent. 


In this case, 


n n 
y Ca a — = y y aay 
N—-0o n—- Ooo 


(m,n)EZ+ x Zt k=1 [=1 


This says that we can determine the convergence of a nonnegative double 
series from the sequence {Sp}? instead of the double sequence {$mn}P n=1- 


Since dm > 0 for all (m,n) € Zt x Z*, the double sequence {s,,} is 
increasing in both indices, while the sequence {s,,,,} is increasing. 


If the double series S- Am,n 1S convergent, Theorem 5.45 implies 
(m,n)EZt xZ+ 
that the double sequence of partial sums {s,,,,,} is bounded above. Being 


a subset, the sequence {s,,,}°°, is also bounded above. By monotone 


iL 


convergence theorem, the sequence {s,,,}°2, is convergent. 
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Conversely, assume that the sequence {s,,,,}°°, is convergent. Then it is 
bounded above. Let 


1 — Sp en — nen 
neZt nN—- Oo 


For any positive integers m and n, 
Sr SOK Sasa 


This implies that the double sequence {,,,,} is bounded above by t. Hence, 


the double series S- Am,n 18 convergent. From the argument above, 


(m,n)EZt x Zt 
we also find that 


sup Sr | — OUD Sane 
(m,n)EZt x Z+ neZt 


Since the oppositie inequality is obvious, this is in fact an equality. Hence, 


) amjn = sup Smn = SUP Snn 
(m,n)eZt xZ+ (m,n)EZt x Zt nezt 


n n 
= lim -s,,, = lim y y Ak: 
n>co n—0o : 


Keil 


Let us look at an example. 


Example 5.42 


Show that the double series 


1 
2 aie 


(m,n)EZ+ x Zt 


is convergent. 
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Solution 


Notice that 


Since the series oy 73 is convergent, the sequence {s,,,} is bounded 
k=1 


: if : 
above. Hence, the double series a 35g 1S convergent. 
(m,n)EZ+ x Zt (m sta ) 


Next, we consider double series that have negative terms. Given a double 
sequence {Amn}rena let {Pmntren=1 and {Gmn}in—1 be double sequences 
defined by 


= pace = Amn = eee - Amn 
Pm,n 5) ) rr 
Then 
ane = Pm,n + dm,n; Amn = Pmn — Imn- 


{Pmntmn=1 and {dmn}Pen=1 are nonnegative double sequences with 
0<Pmn < |@mnl, 0 <Gmn < |@mnl- 
Definition 5.14 Absolute Convergence of Double Series 


We say that the double series S- Qm,n converges absolutely if the 
(m,n)EZt xZ+ 
double series yo |Qmn| is convergent. 
(m,n)EZt x Z+ 


Theorem 5.47 


If the double series ye Qm,n converges absolutely, then it is 
(m,n) EZ+ x Zt 


convergent. 
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For (m,n) € Z* x Z*, let 


_ aa al Amn i lezen a Amn 
Then 
0 = Pmn < [Oran 0 = Am,n < \Qaeenalt 


Let {57 t+ {Smt {tm} and {Sm} be respectively the double sequences 
of partial sums for the double series rs Dare De Gare 


(m,n)EZt xZ+ (mn)EZt x Z+ 


ye |Qmn| and S- Grane Then 


(m,n)EZ+ x Zt (m,n)EZ+ x Zt 


Moreover, 
Wish. Vea Tene (5.6) 


mn mn 


Since {Pmn}, {@mn} and {|am,|} are nonnegative double sequences, 
{Sint {Smnt and {tmn} are nonnegative double sequences that 
are increasing in both indices. By assumption, the double series 


Ss |amn| is convergent. Therefore, the double sequence {tin} 
(m,n)EZt x Z+ 


is bounded above. Eq. (5.6) implies that the double sequences {s;, | and 


mn 


{Smn} are also bounded above. Hence, the double sequences {s7, ,, } and 


{Smn} are convergent. By linearity, the double sequence {5 ,,} is also 
convergent and 


. = . + . = 
lim Sne— lim s4,— lim 327. 
m,n—-oo m,n—- oo m,n—-oo 


This proves that the double series ye Amn 18 convergent, and 
(m,n)EZt x Z+ 


Pmn — Se dm,n: 


(m,n)EZ+ x Zt (m,n)EZt x Zt (m,n)EZt x Zt 


There is a simpler proof of this theorem using the same idea as we prove the 


Chapter 5. Infinite Series of Numbers and Infinite Products 44] 


case for single series. The ideas in the proof that we present above have been 
used when we prove that any rearrangement of an absolutely convergent single 
series is convergent and has the same sum. It is a useful technique for dealing 
with absolutely convergent series. One should compare this proof to the proof 
of Theorem 4.39 for convergence of improper integrals. In fact, infinite series 


and improper integrals are closely related. An improper integral i. f(x)dzx is 


convergent if and only if the double limit 


lim , f(x)dx 


a——oo,b>0o 


exists. This can be rephrased as for any two sequences {a,,.} and {b,,} satisfying 
lim ad, = —oo and lim b,, = oo, the double sequence {F;,,}, with 


m—- co n—->Cco 


bn 
ee = f(a)dx 


am 


is convergent and has the same limit. 

As we have seen before, we cannot simply compute the limit of a double 
sequence by taking the limit with respect to one index first before the other. For 
double series, we cannot find the sum simply by taking the sum with respect to 
one index first before the other. Let us look at the following example. 


Example 5.43 
For (m,n) € Zt x Z*, let 


if |m — n| = 1, 


otherwise, 


and consider the double series S- Gm,n- We find that 


(m,n)EZ+ x Zt 


il. if — i 
0, ia 2. 


= —1, iim=1, ae 
S amyn = y Qmn = 
il 0 m=1 


‘ if fs 
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Therefore, 


E (Suen F(Eae.) 


‘oll Trl \nS) 


We find that changing the orders of summation produces different sums. 


8 9 1011 


12345 678 91011 


Figure 5.4: An illiustration of the terms in the double series defined in Example 


5.43. 
However, we have the following if the double series is convergent. 


Theorem 5.48 


Assume that the double series ye Qm,n converges to s, and for 


(m,n) EZ+ x Zt 
ore 


every fixed m € Z", the series S- Qm,n 1S convergent with sum u,,. Then 


n=l 


the series 


m= n=l 


is convergent and its sum is s. 
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m on 
Smn = y y Qk l- 


k=1 [=1 


We are given that the double sequence {8mn}7n=1 converges to s. Notice 
that for fixed m € Zr, 


This shows that for fixed m, the limit b,, = lim s,,,, exists and it equal to 
n—- Oo 


ye Ux. By Theorem 5.42, the sequence {b,,,} converges to s. Therefore, 


k=1 
co 


the series y Um 18 convergent and has sum s. 


ol 


Let us explore more about nonnegative double series first. 
Theorem 5.49 


Given that SS G@mn 18 a double series with a, > O for all 
(m,n)EZt x Z+ 
(m,n) € Z* x Z*, and it is convergent with sum s. We have the following. 


(a) For all m € Z*, um = 2 Amn is finite. 


nl 


(b) For all n € Z*, v, = se Amn is finite. 
m=1 


(c) The series ve Um, and the series Se Un both converge to s. Namely, 


m=1 n=1 


oo e-°) CO 6000 
y y > y amyn = Qm,n- 


m=1 n=1 n=1m=1 (m,n)EZt xZ+ 
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Given positive integers m and n, let 


m n n 
i = S S Qmn, Um = S Am,1, 
=i 


(r= (il 


m n 
a y Uk,n = y Um,l- 
ip=il ci) 


Since Gm n > 0 for all m,n € Zt, we have 
Tees Ue s forall, wie Zo x7. 


For fixed m, {tm }021 and {5,,,}?2, are increasing sequences. For fixed 
N, {Umn}Po_, and {S,,,}°°_, are increasing sequences. 


Since the double series y Qmn 1S convergent with sum 8, Smn < s 
(m,n)EZt x Z+ 
for all positive integers m and n. Therefore, the sequences {tn }°21, 


{Sm n}r_1, {Umm }P_1 and {Sm,}P°_, are increasing sequences that are 
bounded above by s. Therefore, each of these sequences is convergent. 
The convergence of the sequences {tm n $72, and {Um n}Po_, are precisely 
the statements in (a) and (b). By definition, 


[o@) Co 
= ) Caen = TN Mees v= ) Cae = iC wes 
noo m—-cooO 
m= ll ml 


Now let 


be the partial sums of the series SS Um and SS Un. From (5.7), we find 


ml n=1 


that 


im c= Y Ue = 0s. im i » Ui C. 


From these, we find that the sequences {b,,,} and {c,} are also increasing 
sequences that are bounded above by s. 
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Therefore, 


b= lim bd» and e@= lim @, 
mM—- Oo n—->oco 


exist, and b < s,c < s. We are now left to prove that b = c = s. It is 
sufficient to prove that b = s. Then c = s follows by interchanging the 
roles of m and n. Given ¢ > 0, using the fact that s = sup {Sip |n€ De 
from Corollary 5.46, we find that there is a positive integer NV such that 


SN.N > S8—€. 


But then 
N N Noo 
suv = damn S 7D dn = by. 
m=1 n=1 m=1 n=1 
This shows that 
bn 2S S—é, 


Hence, 
b=supb, > s—€. 
m 


Since ¢ > 0 is arbitrary, we conclude that b > s. Together with b < s that 
is proved earlier, we conclude that b = s. 


Theorem 5.50 


Given that SS Gm,n 18 a double series with a,,,, > O for all 


(m,n)EZ+ x Zt 
oe 


(m,n) € Z* x Z*. Assume that for each m € Z*, the series Sune 


n—1 
lo) 


converges to U,,. If the series SS Um 1S convergent, then the double series 
mo 
SS Qm,n 1S convergent, and 
(m,n)EZt xZ+ 


Se a 5 2 (>: on] | 


(m,n)EZt x Z+ m=1 \n=1 
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Co 
It is sufficient to prove that the convergence of the series SS Um implies 
ml 
the convergence of the double series » GQmn- The last statement 


(m,n)EZt xZ+ 
ore 


then follows from Theorem 5.48. Assume that the series 3S Um Converges 


m=1 
to u. Using the same notations as in the proof of Theorem 5.49, we find 
that for each positive integer m, the sequence {tm }°2, increases to Um. 
From (5.7), we find that for any positive integers m and n, 


m 
Smn S y Un Su 
k=1 


This shows that the double sequence {mn}? ,=1 is bounded above, and 


hence it is convergent. Therefore, the double series > Gren is 


(m,n)EZt x Z+ 
convergent. 


Remark 5.4 


Putting together Theorem 5.49 and Theorem 5.50, we conclude the 


following. Given a double series Se Qm,n With nonnegative terms 
(m,n)EZt xZ+ 
Gm,n, We can determine its convergence and find its sum by first checking 
(oe) 


whether for each fixed m, the series Se Gm.n 18 convergent. If yes, find 


nal 
oo 


the sum, call it as w,,., and check whether the series » Um iS convergent. 
ml 
If yes, then the double series SS Am,n 18 Convergent and its sum is 
(m,n)EZt x Z+ 


co 
given by ~ Um- Namely, the sum of the double series S° Ce 
m=1 (m,n)EZ+ x Zt 
can be obtained by iterated summation. 
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oe) 


We can also start with the series > Q@m,n for each fixed n. This shows that 
mal 

for double series with nonnegative terms, we can interchange the orders of 

summation. In fact, with slightly more effort, one can prove that we can 


sum in any orders. 
co 


If for some integer m, the series Gm,n 18 divergent, then the double series 


n=l 
lo) 


y Qmn 18 divergent. Even if the series y Qm,n 1S convergent for 


(m,n)EZt xZ+ n=1 
oe 


all positive integers m, the series SS Um can still be divergent. In this latter 
m=1 
case, the double series S- Qm,n 18 divergent. An example is given 
(m,n)EZ+ x Zt 


ih 
Ss m2 + n2° 


(m,n)EZ+ x Zt 


by the double series 


[oe] 
ee : ; ; 1 
For fixed positive integer m, comparison with the series y —; shows that 
n 


all 


co 
: 1 : , 
the series y ae is convergent. By integral test, we find that 
m+n 
n=1 


1 = 1 1 7 1 
: Sa m+a m2 Im me 


peak 


(oe) Cc 


Since the series DS — is divergent but the series ye —,, is convergent, 
m m 


mal n=l 
oo 


is divergent. Hence, the series y Ue, 1s 
m=1 


divergent. 


Finally, we can come back to series with negative terms. From Theorem 5.49, 
we have the following. 
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Theorem 5.51 


Given that S @m,n 18 a double series that converges absolutely, 
(m,n)EZt xZ+ 
and it is convergent with sum s. We have the following. 


(a) For all m € Z*, um = Sy Amn is finite. 


nl 


(b) For alln € Z*, v, = Ss Amn is finite. 
m=1 


(c) The series 2 Um, and the series Ss Un both converge to s. Namely, 


m=1 n=1 


CO 6000 CO 000 
y y Tee y amyn = Qm,n- 


m=1 n=1 n=1m=1 (m,n)EZt xZ+ 


Using the same notations as in the proof of Theorem 5.47, since the double 
series Sy |Qm.n| is convergent, the double series a Dan 
(m,n)EZ+ xZ+ (m,n)EZt x Z+ 
and Se mn are convergent. Applying Theorem 5.49 to the 
(m,n)EZt x Zt 
nonnegative series » Pmn and S- dm.n, we conclude that 
(m,n)EZt x Z+ (mn)EZt x Z+ 


for all m € Z* and all n € Z", the series Sy iors ss Qmyn> we Pmmn and 


1 ol ma 
ioe) 


y dm.n are convergent. Since 


m1 


Amn = Pm,n — Im,n for all (m, n) OI Ts 


[o-e) (oe) 
we conclude that the series y Qm,n and the series y Amn are convergent. 


n=1 m=1 
The remaining assertions are concluded using the same arguments. 


This theorem says that absolutely convergent double series enjoys almost the 
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same privileges as the nonnegative double series. The following theorem gives a 
summary. 


Theorem 5.52 


Given that ys G@m,n 18 a double series that satisfies the following 
(m,n)EZt xZ+ 
conditions. 


co 


(i) For each fixed m € Z™, the series > |Gmn| is convergent. 


i—1 


[oe) [oe) 
(ii) ss S- |Qm.n| is convergent. 


i) 1 


We have the following. 


(a) The double series SS Amn converges absolutely. 


(m,n)EZt x Zt 


(b) For each fixed n € Z*, the series SS Amn converges absolutely. 
m=1 
(c) For each fixed m € Z™, the series SS Qm,n converges absolutely. 


i! 


(oe) 


(d) Both the series Ss S Qmn| and Ss ‘ Qm,n| are convergent. 
m—) 


ma) |e n=1 


(e) The sum of the double series can be computed by iterated summation. 
Namely, 


es Ce co 000 
y amyn = y y amyn = y y Qm,n- 


(m,n)EZt x Zt m=1 n=1 n=1 m=1 


By Theorem 5.50, (i) and (ii) implies that the double series 


y |Qmn| is convergent, which gives (a). 
(m,n)EZt x Zt 
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By Theorem 5.49, (a) implies (b) and (c). Theorem 5.49 also implies that 
the two series 


E (Fhe) oa F (Ele! 


ma=1 \ n=1 \m=1 


are convergent. Since 


[o-e) [o-e) [o-@) (oe) 
SE aS lesa: Seals esa 
n=1 foal m=1 m=1 


wo |] & wo | & 


comparison test shows that the series S- ys Qmn| and Se Se Qm,n| are 
I 


m= |n=1 m=1 
convergent. This gives (d). The statement (e) follows from (a) and Theorem 
Seoul 
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Exercises 5.5 


Question 1 
If a and b are positive constants, show that the double series 
Se oe 
rer am? + bn? 


is divergent. 


Question 2 


Given that a and 0 are positive constants, u and v are real numbers, and a 
is anumber larger than 1. Show that the double series 


sin(mu + nv 
J ( ) 


(am = bn) 


(m,n)EZ+ x Zt 


is convergent. 
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Chapter 6 
Sequences and Series of Functions 


In this chapter, we study sequences and series whose terms depend on a variable. 


6.1 Convergence of Sequences and Series of Functions 


Let D be a subset of real numbers. For each positive integer n, let f,, : D — R be 


a function defined on D. Then {f,,}°°, is a sequence of functions defined on D. 
Sometimes we will write {f,,: D — R} or {fn : D + R}°°, to make it explicit 
that each f,, is a function defined on D. 


Given a sequence of functions { f,, : D — R} that are defined on D, for each 


x € D, {fn(x)} is a sequence of real numbers. We can determine whether such a 


sequence is convergent. 


Definition 6.1 Pointwise Convergence of Sequence of Functions 


Given a sequence of functions {f,, : D — R} that are defined on D, we 


say that it converges pointwise to the function f : D — R provided that 
for every x € D, the sequence { f,,(x)} converges to f(x). Namely, 


(2) — lima) fy ae) for all x € D. 


n—-> co 


In this case, we also say that the function f : D — R is the pointwise limit 


of the sequence of functions {f,, : D > R}. 


Let us look at some examples. 


Example 6.1 


For each positive integer n, let f;, : [0,1] — R be the function f, (x) = x”. 


Study the pointwise convergence of the sequence of functions { f,, }. 
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Solution 
Notice that 
1G es oe al 


i elle 


Therefore, the sequence of functions {/f,} converges pointwise to the 
function f : [0,1] + R, where 


i roa, 
it ge= i, 


Figure 6.1: The sequence of functions { f,,} defined in Example 6.1. 


Example 6.2 


For each positive integer n, let f,, : [0,2] — R be the function f,,(”) = x”. 
Study the pointwise convergence of the sequence of functions { f,}. 


Solution 


For each x € [0, 1], the sequence { f,,(2)} is convergent. For any x € (1, 2], 


the sequence { f,,(2)} is divergent. Hence, the sequence of functions { f,, } 
does not converge pointwise. 
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In Example 6.1, notice that each f,, : [0,1] — R is a continuous function, 


but the limit f : [0, 1] + R is not a continuous function. 


Given that {f, : D — R} is a sequence of functions that converges 


pointwise to the function f : D — R. We will consider the following 
questions. 


1. If each f,, is continuous, is f continuous? 


2. If each f,, is a differentiable function defined on an open interval J, is f 


differentiable on /? If yes, does the sequence { f/ : J + R} converge to 
fi:I3R? 


. If each f,, is Riemann integrable on a closed and bounded interval J, 
is f Riemann integrable on J? If yes, does the sequence of integrals 


{ i fn converge to the integral | re 
iE ik 


We have seen that the answer to the first question is no, as given by Example 
6.1. The answers to the second and third questions are also no. We will look 


at some examples. 


Example 6.3 


For each positive integer n, let f,, : R — R be the function 


_ 1 
~~ L4+ na? 


fn(@) 


Study the pointwise convergence of the sequence of functions { f,,}. 


Solution 
Since f,,(0) = 1 for alln € Zt, 
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By squeeze theorem, 


Lira, 2) — 10) when x # 0. 


n—-co 


Hence, the sequence of functions { f,,} converges pointwise to the function 


f :R—R, where 


if x £0, 
ifx =0. 


ol 


Figure 6.2: The sequence of functions { f,,} defined in Example 6.3. 


In Example 6.3, each of the functions f,, is differentiable. But the function 
f is not differentiable at x = 0 since it is not continuous at x = 0. 


Example 6.4 


For each positive integer n, let f,, : R — R be the differentiable function 


le) — ge 


(a) Study the pointwise convergence of the sequence of functions { f,, }. 


(b) Study the pointwise convergence of the sequence of functions { f/ }. 


Solution 


(a) Since f,(0) = 0 for all n € Z*, 


lereay yp (0s) = 0) 


n—- co 
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If x £0, since lim e“ = 0, we find that 
UU OO 


Ba nee? ae 
liming (tee lite 9 ee lime — 10): 


Hence, the sequence of functions { f,, } converges pointwise to the function 
f:R—-—R, where f(z) =O forallz ER. 


(b) Forn € Z*, 
f(a) = (1 —2nz)er™. 


n 


Since f’ (0) = 1 forall n € ZT", 


lim (0) =1. 


n—- co 


If x £ 0, since lim e~“ = O and lim ue “ = 0, we find that 
U—- Oo 


U—>Co 


lim f’(x) = lim (1— Qnz)e™ = lim (1 — 2uje™" = 0. 
n> co N+ Co uUu—->oo 


Hence, the sequence of functions {f/} converges pointwise to the 


function g : R > R, where 


if x £0, 
if z =0. 


Figure 6.3: The sequence of functions { f,,} defined in Example 6.4. 
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Figure 6.4: The sequence of functions { f/ } in Example 6.4. 


In Example 6.4, each of the functions f,, is differentiable and the function 
f is also differentiable. The sequence { f’ } also converges pointwise, but it 
does not converge to the function f’. 


Example 6.5 


For each positive integer n, let 


8.={2|nge2,0<psasma>ih. 
q 


Define the function f,, : [0, 1] > R by 


ifx€e Sp, 
0, ifad Sy. 


Study the pointwise convergence of the sequence of functions { f,,}. 


Solution 
If x is a rational number in [0, 1], there exists a nonnegative integer p and a 
positive integer q such that 0 < p < q and x = p/q. Therefore, x € S,, for 
all n > q. This implies that f,,(”) = 1 for all n > q. Hence, 


nen eal ab if x is rational. 
n—>co 
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If x is not a rational number, then x ¢ S,, for any n € Z*. Therefore, 
fr(x) = 0 for all n € Z*. Hence, 


Intech ee 10 if x is irrational. 
n—-oco 


These show that the sequence of functions { f;,} converges pointwise to the 
Dirichlet function f : R — R, 


if x is rational, 


if x is irrational. 


For each n € Z*, the set S,, which f,(x) 4 0 is finite. Thus the function 
fr : [0,1] + R is Riemann integrable. But the Dirichlet function f is not 
Riemann integrable. 


Example 6.6 


For each positive integer n, let 


n?z(1— nz), fo <a < 4 


0, otherwise. 


1 
Notice that f,, is integrable on [0, 1]. Let c, = | Hi Ue ohne 
0 


(a) Study the pointwise convergence of the sequence of functions { f,, }. 
(b) Determine the limit of the sequence {c,, }. 

Solution 
(a) Since f,,(0) = 0 for all n € Zt, 


lim f,,(0) = 0. 


N—- Co 
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If x > 0, there is a positive integer N so that x > 1/N. This implies that 
fr(x) = 0 for all n > N. Hence, we also have 


lien (ee — Oe 


n—-co 


Thus, the sequence of functions {f,,} converges pointwise to the function 
f:R—-R, where f(x) = 0 for all x € 


(b) We compute c,, directly. For n € Z*, 


Hence, the sequence {c,,} converges to 1/6. 


In Example 6.6, each of the functions f,, is integrable and the function f is 


1 
also integrable. However, { | fn} does not converge to | de 
0 0 


Figure 6.5: The sequence of functions { f,,} defined in Example 6.6. 


Now let us consider series of functions. 
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Definition 6.2 Pointwise Convergence of Series of Functions 


A series of functions defined on a set A is a series of the form 


Sey 


where { f,, : A — R} is a sequence of functions defined on A. For such a 


series, we form the partial sum 


Sa He fora 1) 
k=l 


Then {s, : A — R} is a sequence of functons defined on A. The domain 


of convergence of the series Le fn(x) is the set 


nal 


D = {x € A| the sequence {s,(x)} is convergent} . 


It is the largest subset D of A such that the sequence of functions {s,, : 


D — R} converges pointwise. For each x in D, let 


n—-oco 


sr) = SS jc — limes, (2) 


be the sum of the series. Then the sequence of functions {s,, : D — | 
converges pointwise to the function s(z). 


Let us reformulate Theorem 5.16 using series of functions. 


Example 6.7 Geometric Series 


(oe) 


For the series a x", the terms are the functions f,(~) = 2", n > 0. They 
n=0 


are defined on A = R. The partial sums are 


i grtl 


8,(v) =1l+at+-.-+a"=¢ 1l-a@ 
fap ls he 


; ie = |. 
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The domain of convergence is the set D = (—1,1). Forx € D, 


[o-e) 1 
a aes zee 
n=0 


lo) 


Hence, the series of functons y x" converges pointwise on the interval 


n=0 


aH 
(—1, 1) to the function s(az) = ee 
—£ 


Example 6.8 


(oe) 


Determine the domain of convergence of the series y e 


nai 


n2a 


Solution 


If x <0, —n2x > 0 forall n € Zt. Therefore, lim e~”’” # 0, and so the 
nN—-0o 


co 
: ee : 
series y e " * is divergent. 
nl 


If x > 0, lim e-”® — Q. In this case, notice that n? > n for all n € Zt 


N—->Co 


implies that 
O<er<e™ for alln € ZT. 


lo) 
Since the series y e "” is a geometric series with positive constant ratio 


io 
oo 


r =e * <1, itis convergent. By the comparison test, the series Se e- 


(=| 


n2x 


is also convergent. 
[o-@) 


Therefore, the domain of convergence of the series SS oe is Dp = 


n=l 


(0, co). 
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Exercises 6.1 


Question 1 


For each positive integer n, let f,, : R — R be the function defined by 
Ce ate ame 


(a) Determine the pointwise convergence of the sequence of functions 


{fat 

(b) Determine the pointwise convergence of the sequence of functions 
dene 

Question 2 

For each positive integer n, let f,, : (0,00) — R be the function defined by 


i) 


In(2) = 1+a" 


(a) Determine the pointwise convergence of the sequence of functions 


{fn}. 


(b) Determine the pointwise convergence of the sequence of functions 


{fal 


Question 3 


For each positive integer n, let f,, : [0, co) — R be the function defined by 


1 
and let a=) inl VG ae 
0 


(a) Determine the pointwise convergence of the sequence of functions 


{fn}. 


(b) Determine the convergence of the sequence {c,, }. 
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Question 4 


For each positive integer n, let f,, : R — R be the function defined by 


fle) — sin —) : 


1 
and let n= f Fears 
0 


(a) Study the convergence of the sequence of functions { f,, }. 
(b) Study the convergence of the sequence of functions { f/ }. 
(c) Determine the limit of the sequence {c,, }. 


Question 5 


co 
Find the domain of convergence of the series of functions Ss ne 


mil 


nx? 


Question 6 


CO 
Find the domain of convergence of the series of functions SD ne” 


foal 


nea 
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6.2 Uniform Convergence of Sequences and Series of Functions 


In Section 6.1, we have seen examples where a sequence of functions {f,, : D > 


R} converges pointwise to a function f : D — R, but some properties of the 


sequence { f,,}, such as continuity, differentiability, or integrability, are lost in the 
limit function f. We also see an example where differentiability is preserved, but 
the derivative of f is not the limit of the derivatives of the sequence { f,,}. There is 


also an example where each function f,, is integrable over an interval J, f is also 


integrable over J, but the limit of the sequence | fin 1S not | iz 
E I 


Given that {f, : D — R} is a sequence of functions that converges 


pointwise to the function f : D> R. 


1. Continuity of each f,, does not imply the continuity of f. 


lim lim f,(2) does not necessary equalto lim lim f,(z). 
L—->x0 N—->0o noo L420 


2. The derivative of f does not necessary equal to the limit of {f/ } 


d d 

— lim f,(x) does not necessary equal to lim —f,,(x). 

dt nc noo dv 

3. The integral of f over an interval [a,b] does not necessary equal to the 


limit the integrals of f,, over [a, 0]. 


b b 
/ lim f,(a)dx does not necessary equal to lim i) pale ae. 


N—->Co 
a 


Since derivatives and integrals are also limits, all these pathological 
behaviors have the same root. Namely, one cannot simply interchange the 
orders of two limits, as have been shown in Section 5.5. 


In this section, we are going to introduce the concept of uniform convergence. 
We are going to see in next section how this extra condition can help to remedy 
some of the pathological behaviors mentioned above. 


Let us review Example 6.1. The sequence f,, : [0,1] > R, f,(a) = x” is 
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found to converge pointwise to the function f : [0,1] + R given by 


0, if0<a<1, 
1, tf =, 


For the point x = 1, { f,,(1)} converges to f(1) = 1. For any < > 0, we can take 
N =1. Then for alln > N, 


lfn(1) — f(1)| =O0<e. 


The same goes for the point x = 0. For any other x in the interval (0,1), {f,(2)} 
converges to f(x) = 0. Given e > 0, if e < 1, the smallest NV such that 


lfn(z) — f(x)| =a" <e for alln > N 


is the smallest positive integer NV such that 


Ns Ine 


Ina 

One see that this number NV would become larger and larger when x approaches 1. 
The idea of uniform convergence is to say that NV can be chosen to be independent 
of the point x in the domain. 


Definition 6.3 Uniform Convergence of Sequences of Functions 


Let D be a subset of real numbers. We say that a sequence of functions 


{fn : D — R} converges uniformly to the function f : D — R, provided 


that for every « > 0, there is a positive integer N such that for all n > N, 
and all x € D, 


|fn(a) — f(@)| <e. 


Obviously, we have the following. 


Proposition 6.1 


Let D be a subset of real numbers. If {f, : D — R} is a sequence of 


functions that converges uniformly to the function f : D — R, then the 


sequence { f,, : D — R} converges pointwise to f : D > R. 


Chapter 6. Sequences and Series of Functions 466 


Figure 6.6: Uniform convergence of a sequence of functions. 


Uniform Limit and Pointwise Limit 


If a sequence of functions {/;, : D — R} converges uniformly, the uniform 


limit is the same as the pointwise limit. 


Let us compare the definitions of pointwise and uniform convergence using 
logical expressions. 


Pointwise Convergence versus Uniform Convergence 


The sequence of functions {f,, : D — R} converges pointwise to the 
function f: DR. 


Veep, YVe>0, 4aN EZ’, Vn > N, \fr(@)—f@)|<e. 


The sequence of functions {f,, : D — R} converges uniformly to the 
function f: DR. 


Ve>0, INE Zt, VxeED, Vn>NQN, |fa(x) — f(x)| <e. 


One sees that it is a matter of the ordering of the quantifiers, but it makes 
a significant difference when we interchange the orders of a universal quantifier 
with a existential quantifier. 

One should also compare the definition of uniform convergence to uniform 
continuity that we discussed in Section 2.5. In both cases, the uniformity is with 
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respect to the domain D. 


Before looking at some examples, let us highlight the negation of uniform 


continuity. 


Non-Uniform Convergence 


In logical expressions, the sequence of functions { f,, : D — R} does not 


converge uniformly to the function f : D — R is expressed by 


de>0, VN eZ ae D, ano Ne ie fe@e)|ee. (6.1) 


The following gives a prelimary test for uniform convergence. 


Proposition 6.2 


If a sequence of functions {f,, : D — R} does not converge pointwise, 


then it does not converge uniformly. 


If the sequence {f, : D —> R} does converge pointwise, to show that it 


does not converge uniformly, we only need to establish the statement (6.1) with 
f : D = R the pointwise limit of the sequence {f, : D > R}. 


Example 6.9 


Born 1 let: 


[0,1] — R be the function f,,(x) = x”. Show that the 
sequence {f,, : [0,1] — R} 


does not converge uniformly. 


Solution 


In Example 6.1, we have seen that the sequence { f,,} converges pointwise 


to the function f : 
If {f, : [0,1] > 


function f :: [0,1] > | 


(oa 


R, where f(x) = 0 for x € [0,1) and f(1) =1. 


R} converges uniformly, it must converge to the same 
R. Take ¢ = 4. There must be a positive integer NV 


2° 
such that for all n > N, for all x € [0,1], 


fal) — F(2)) <5 
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In particular, this says that for all x € [0, 1), 


This is absurd since lim « = 1. Hence, the sequence {f, : [0,1] > 1 
ile 


does not converge uniformly. 


Example 6.10 


For n > 1, let f,, : R — R be the function f,(2) = xe-"® . Show that the 
sequence { f,, } converges uniformly. 


Solution 
In Example 6.4, we have seen that the sequence { f,,} converges pointwise 
to the function f : R — R that is identically 0. Notice that 


(x) = (1—2nzx?)e™. 


This shows that f’ (a) > 0 for |z| < 1/V2n, and f/(x) < 0 for |z| > 
1/V2n. Since 
lin) — Oe and lime. — 0 
N= —1e. 9) N—+0o 
we find that f,,(2) decreases from 0 to f,(—1/W2n) when x goes from —oo 
to —1/V/2n, f,(x) increases from f,,(—1/V2n) to f,(1/V2n) when x goes 
from —1/V2n to 1/V2n, and f,,(a) decreases from f,(1/V2n) to 0 when 


x goes from 1/./2n to oo. Hence, the minimum and maximum values of 
fr are fr(—1/V2n) and f,(1/V2n) respectively. This shows that 


lfn(z)| < fr(1/V2n) = = for allz € R. 


Given ¢ > 0, there is a positive integer N such that 1//2N < e. For all 
n € N, for all x € R, we find that 
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|fn(a) — f(@)| = |fn(@)| 


This proves that the sequence of functions { f,, } converges uniformly to the 
function f that is identically 0. 


By definition, if a sequence of functions {f,, : D — R} converges uniformly 


to the function f : D — R, then there is a positive integer No such that for all 
n= No, 


lfn(z) — f(x)| <1 for all x € D. 


This implies that for all m > No, the function (f, — f) : D — R is bounded 
above, and thus V/,, = sup |f,(a) — f(x)| exists. 
«ED 


The following theorem provides a systematic way to determine whether a 


sequence of functions { f,, : D — R} converges uniformly. 


Theorem 6.3 


Let D be a subset of real numbers, and let { f,, : D — R} be a sequence of 


functions defined on D. 


I. If the sequence of functions {f, : D —> R} does not converge 


pointwise to a function, then it does not converge uniformly. 


. If the sequence of functions {f, : D — R} converges pointwise 


to a function f : D — R, for each n € Z, define the function 


(a) If g, is not bounded for infinitely many n, then the sequence of 


functions { f,, : D + R} does not converge uniformly. 


(b) If only finitely many of the functions g,, are not bounded, there is 
a positive integer No such that g,, is bounded for all n > No. For 


n > No, let M, = sup |gn(x)|. Then the sequence of functions 
zeED 


{fn : D — R} converges uniformly to the function f : D > Rif 
and only if lim M,, = 0. 
N—->Co 
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We have addressed I. and II. (a). Let us now consider II. (b). If the sequence 


of functions {f,, : D — R} converges uniformly to the function f : D > 


R, given € > 0, there is a positive integer N > No such that for all n > N 
and for all x € D, 


lgn(x)| = |fnlx) — f(2)| < =. 


This gives 
0< M, = sup|ga(z)| < 5 <e for alln > N. 
xED 


Therefore, lim M,, = 0. 
Conversely, if lim M,, = 0, given e > 0, there is a positive integer V > No 
such that us 

Mn <€ foralln > N. 


It follows that for all n > N, for all x € D, 


i ) a f(2)| a |9n(x)| < i l9n(x)| = M, <e. 


This proves that the sequence of functions {f, : D — R} converges 


uniformly to the function f : D > R. 


Example 6.11 


For the sequence of functions discussed in Example 6.9, 


ie 
ic — ele 


Therefore, 


= sup | f(z) — f(z) = 1. 


O0<a<1 


Since lin M, = 1 # 0, Theorem 6.3 implies that the sequence of 
nN 0oo 


functions {f;, : [0,1] > R} with f,,(~) = x” does not converge uniformly. 
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Example 6.12 


For the sequence of functions discussed in Example 6.10, f,(2) — f(x) = 
ae xe-"™. We have shown that 


My = sup |fa() ~ F(0)] < = 


This implies that lim M,, = 0. Hence, Theorem 6.3 says that the sequence 
NM? CoO 


of functions { f,, : R > R} with f,(x) = xe" converges uniformly. 
y 


To apply Theorem 6.3, we need to know apriori the pointwise limit of the 
sequence of functions { f,,} to be able to conclude the uniform convergence of the 
sequence. Sometimes it could be difficult to find the limit function. To circumvent 
this problem, we introduce the concept of uniformly Cauchy. 


Definition 6.4 Uniformly Cauchy Sequence of Functions 


Let D be a subset of real numbers. A sequence of functions { f,, : D + R} 
is uniformly Cauchy provided that for every « > 0, there is a positive 
integer NV such that for allm >n > N, 


Fel) = tn | oe for all x € D. 


We have the following. 


Theorem 6.4 
Cauchy Criterion for Uniform Convergence of Sequences of Functions 


A sequence of functions { f,, : D — R} converges uniformly if and only if 
it is uniformly Cauchy. 


If the sequence of functions {f, : D — R} converges uniformly to f : 


D — R, given < > 0, there is a positive integer NV such that for alln > N, 


Ira )- f@)<5 for all x € D. 
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Using triangle inequality, this proves that for allm > n> N, 


lanl) = fale le for all x € D. 


This proves that the sequence { f,, : D — R} is uniformly Cauchy. 


Conversely, if the sequence of functions {f,, : D — R} is uniformly 


Cauchy, then for each x € D, the sequence { f,,(a)} is a Cauchy sequence. 
Hence, it converges to a number f(x). This shows that the sequence of 


functions {f, : D — R} converges pointwise to a function f : D > R. 
To show that the convergence is uniform, given ¢ > 0, there is a positive 
integer N such that for allm >n > JN, 


inl — fle) = 5 for all x € D. 
For each x € D, fixed n > N and take the limit m — oo, we find that 
|fn(z) — f(@)| S 5- 
This proves that for all n > N, for all x € D, 


|fn(a) — f(@)| <e. 


Therefore, the sequence of functions {f,, : D — R} converges uniformly. 


Using Theorem 6.4, Theorem 6.3 can be finetuned as follows. The proof is 
straightforward and we leave it to the exercises. 


Theorem 6.5 


Given that { f,, : D — R} is a sequence of functions defined on the subset 


D of real numbers, for each pair of (m,n) € Z*+ x Z, define the extended 


real number M,,,,,, as 


xzED 


Then the sequence of functions { f;, : D — R} converges uniformly if and 


only if the double sequence { /,,, ,} converges to 0. 
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Next we turn to series of functions. 


Definition 6.5 Uniform Convergence of Series of Functions 


Let D be a subset of real numbers and let {f,, : D — R} be a sequence 


of functions defined on D. We say that the series of functions De tala) 


n=1 
converges uniformly to the function s : D — R provided that the sequence 


of partial sums {s,,: D + R} with s,,(x) = > f(x) converges uniformly 
k=l 


to the function s(x). 


Uniform Convergence of Series of Functions 


A necessary condition for a series of functions to converge uniformly is that 


it converges pointwise. 


[o-e) 
When the series of functions oy f(x) converges pointwise to a function 
n=1 


s(x) ona set D, then for any n € Z* and any x € D, the series 


So fe(a) 


converges pointwise to the function s(z) — s,_(x), where s,(%) = 


Ss" f(x) is the n™ partial sum, and so(x) = 0 by default. 
k=l 


Therefore, we can reformulate the definition of uniform convergence of 


oe) 


series of functions as follows. The series 2 fn(z) converges uniformly 


ik 
to the function s(x) on the set D provided that for any « > 0, there is a 
positive integer N such that for alln > N, 


Fo Boe for all x € D. 
— 


In most cases, such as Example 6.8, we can only justify a series of functions 
converges pointwise, but we cannot find an explicit close form for the sum s(z). 
In this case, a Cauchy criterion becomes useful. 
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From Theorem 6.4, we obtain the following immediately. 


Theorem 6.6 
Cauchy Criterion for Uniform Convergence of Series of Functions 


A series of functions Ss fn(x) converges uniformly on a set D if and only 


n=1 
if for every € > 0, there is a positive integer NV such that for allm > n > N, 


for all x € D. 


Example 6.13 


Co 
For the series Se e-”® considered in Example 6.8, we have shown that 
n= 


it converges pointwise on the interval (0,00). Let us prove that the 
convergence is uniform on any set D of the form D = [a,oo), where a 
is a positive constant. 

We notice that ifm > n and ax >a, 


—na 


m m fore) fore) 
0< ae = ee ES Soe x ee = — 
—T k=n k=n kn 


Given € > 0, since 


, ge 
iia —(() 
noo 1 — e-4 


there exists a positive integer NV such that for alln > N, 


—na 


e€ 
0 << —— <e. 
l-—e? 
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It follows that for all m > n > N, and for all x € |a, oo), 


m 


Se eee 
l—e-@ 


k=n 


By Theorem 6.6, the series gee converges uniformly on |a, co). 
y 


n=) 


(oe) 


: : : =e 
The readers are invited to show that the series >» e "* does not converge 
n=1 


uniformly on the set (0,00). It is a typical situation that allthough the series 
converges pointwise on a set A, it fails to converge uniformly on A, but it converges 
uniformly on subsets of A. Most of the time, we do not need uniform convergence 
on A, but uniform convergence on a collection of subsets of A whose union is A 
is enough. In the example above, @ = {|a, 00) | a > 0} is a collection of subsets 


of A = (0, 00) whose union is A. 


Definition 6.6 Absolute Convergence of Series of Functions 


lo-e) 
A series of functions fn(x) is said to converge absolutely on a set D 


(il 


[o-e) 
if the series DS |f.(z)| converges pointwise on D. In this case, the series 


i 


[o-@) 
Si fn(x) also converges pointwise on D. 
n=1 


Now we present a useful test to show that a series of functions converges 


absolutely and uniformly on a set D. 


Theorem 6.7 


Let {f, : D — R} be a sequence of functions defined on D. If the series 


ze | fn(x)| converges uniformly on D, then the series a fn(x) converges 


i! 


n=1 
absolutely and uniformly on D. 
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co 
Since the series De |fn(a)| converges uniformly on D, it also converges 


(ail 


co 
pointwise. Hence, the series Ss fn(x) converges absolutely on D. 


n=1 
Since SS | f.(a)| converges uniformly on D, it is uniformly Cauchy. Given 
n=1 


€ > 0, there is a positive integer NV such that for allm >n => N, 


Se Gel <2 for all xz € D. 
k=n 


Triangle inequality implies that 


m 


S- fe (x) <3 Wala) <€ for all x € D. 
k—7 


k=n 


Hence, the series Se f,(x) is also uniformly Cauchy on D. Therefore, it 
n=1 
also converges uniformly. 


Theorem 6.8 Weiertrass M-Test 


Let {f,, : D — R} be a sequence of functions defined on D. Assume that 


the following conditions are satisfied. 


(i) For each n € ZT, there is a positive constant M,, such that | f,(x)| < 
M, for all xz € D. 


[o-@) 
(ii) The series Ss M,, 1s convergent. 


i=!) 


Then the series SD fn(x) converges absolutely and uniformly on D. 


=) 
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By Theorem 6.7, we only need to show that the series Ne | fn(x)| converges 


al 
oo 


uniformly on D. Given € > 0, since the series ye M,, is convergent, there 


—I 
is a positive integer N such that for allm > n> N, 


m 
S- M,, < ee 
k=n 


This implies that 


m 


S| fe(x)| < $0 Ma <e for all x € D. 
k=n 


k=n 


By Theorem 6.6, the series SS | fn(x)| converges uniformly on D. 


in|) 


Example 6.14 


co 
2 


Let a be a positive number. Show that the series Soi: ‘ 
m=ll 


converges absolutely and uniformly on [a, co). 


Solution 


Forme Z* let j-(a) = (ye For x € |a,0o), x > a. Hence, for 
wel. 
ice) = ea = ee = ee. 


Since r = e ™* < 1, the geometric series y e "“ is convergent. By 


pk 


(oe) 

Weierstrass //-test, the series Vere converges absolutely and 
n=1 

uniformly on |[a, 00). 
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Exercises 6.2 
Question 1 


For n > 1, let f,, : [0,1] > R be the function f,(2) = e~””. Show that 
the sequence of functions { f,,} does not converge uniformly. 


Question 2 


For n > 1, let f,, : R — R be the function f,,(2) = nsin (=). Show that 
n 
the sequence of functions { f,,} does not converge uniformly. 


Question 3 


For n > 1, let f,, : [0,27] > R be the function f,,(2) = nsin (=). Show 
n 


that the sequence of functions { f,,} converges uniformly. 


Question 4 


For n > 1, let f, : [0,00) — R be the function f,(x) = = : 
nx 


Determine whether the sequence of functions { f,,} converges uniformly. 


Question 5 


CO 
Let a be a positive constant. Show that the series So(-)" 


n=1 
converges absolutely and uniformly on the set [a, 00). 
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6.3 Properties of Uniform Limits of Functions 


In this section, we are going to see how uniform convergence can avoid the 
pathological behaviours we mentioned in the beginning of Section 6.2. First we 
show that uniform limit of continuous functions is continuous. This is a very 


important result in mathematical analysis. 


Theorem 6.9 Uniform Limit of Continuous Functions is Continuous 


Given that D is a subset of real numbers, and { f,, : D — R} is a sequence 
of continuous functions that converges uniformly to the function f : D — 


R. Then the function f : D > Ris continuous. 


The proof is a standard 1/3 argument. Given x) € D, we want to show 
that f is continuous at xo using the ce — 6 argument. Given « > 0, there is a 
positive integer N such that for alln > N, 


Leal )= se <= for all x € D. 


We are only going to use this statement when n = N. Since fy is 
continuous at Xo, there is a 6 > 0 such that for all x € D, if |~ — x0| < 6, 
then 

E 


Miv(0) — feo) < 5 


From these, we find that if x is in D and |x — xo| < 6, then 


|f(@) — f(@o)| < |F(@) — fu(@)| + [fv (2) — fv (@o)| + |fr(20) — Feo)! 


er 
tp a ee 


This proves that f is continuous at x. 


Chapter 6. Sequences and Series of Functions 480 


Example 6.15 


For the sequence of functions {f,, : [0,1] > | 


pointwise limit f : [0,1] > 1 


is not continuous. Since each f,,, € Z* is acontinuous function, Theorem 


6.9 can be used to infer that the sequence of functions {f,, : [0,1] > R} 
with f,(z) = x” does not converge uniformly. 


Applying Theorem 6.9 to series of functions, we have the following. 


Corollary 6.10 


Given that { f, : D > R} isa Seed: of continuous functions defined on 
D. If the series of functions Se fn(x) converges uniformly on D, then it 


i 


defines a continuous function s : D — R by 


We apply JTheoven 6.9 to the sequence of partial sums {s,,(x)}. Since 


=> fx (2) is a finite sum of continuous functions, it is continuous. 


By hector 6.9, s(x) = lim s,(2) is continuous. 
n—-co 


Next, we turn to integration. 
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Theorem 6.11 


Assume that for each n € Z*, the funtion f,, : [a,b] > R is Riemann 


integrable. If the sequence of functions {f, : [a,b] — R} converges 


uniformly to the function f : [a,b] — R, then f : [a,b] — R is also 
Riemann integrable, and the orders of the limit operation and the integration 


operation can be interchanged. Namely, 


b 


b b 
lim fu(a)de = | f(c\de = | Tim fn(a)de. (6.2) 


N—0o 


Notice that we only assume that each f,, is Riemann integrable. We do not 


need to assume that it is continuous. 


Given ¢ > 0, there is a positive integer N such that for alln > N, 


ale) — Fel =< 3(b—a) for all x € [a, }). (6.3) 


First we take n = N. Since fy : [a,b] > R is Riemann integrable, there is 
a partition P = {x;}*_, of [a,b] such that 


Oi fgets Pe) 


From (6.3), we have 


S € 


36 a) = f(a) = frie) 36 -a) for all x € [a, b]. 


f(x) — 


For any 1 <i < k, if € [x;_1, x;], 


__ int, ful) — sq agy SF) S_ sup f(a) + TCE 7 


This implies that 


‘ & : 
Pe ery eee 


< < SS 
ee eee Ee peer 
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Therefore, 


U(F,P) < Uf, P) +5, 


Thus, 


From this, we conclude that f is Riemann integrable. This in turn implies 
that for any n € Zt, the function f,, — f is Riemann integrable on [a, }], 
and so is the function |f,, — f|. With the same « > 0, we find from (6.3) 
that for any n > N, 


This proves that (6.2) holds. 


Applying Theorem 6.11 to series of functions, we have the following. 


Corollary 6.12 


Given that {f, : [a,b] — R} is a sequence of Riemann integrable 


functions. If the series ye fn(x) converges uniformly, then the function 


n—) 
09 b 


le 


convergent, and we can integrate term by term. Namely, 


Se) eo fn(z) is Riemann integrable, the series Se fala ida 4s 
—Il 


[scent i. [ S fulx)de = y ere 


=i Ye 
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We apply Theorem 6.11 to the sequence of partial sums {s,(x)}. Since 
Eel = > f(x) is a finite sum of Riemann integrable functions, it is 


k=1 
Riemann integrable. The rest follows from Theorem 6.11. 


Example 6.16 


In Example 6.6, the sequence of functions {f, : [0,1] — R} converges 


pointwise to the function f : [0,1] — R that is identically 0. However, 


1 Ik 
since | fr(x)dx = 1/6, the sequence { | fu(c)aeh does not converge 
0 0 


iL 
to | f (x)dx = 0. Theorem 6.11 can be used to deduce that { f, : [0, 1] > 
0 


R} does not converge to f : [0,1] > R uniformly. 
In fact, one can verify that 


M,= sup |f,(t) — f(a)| = sup nx (1—ne) =". 
0<a<l1 0<a<1/n 4 


Since lim M, 4 0, {fn : [0, 1] + R} does not converge to f : [0,1] >| 
N+ Co 
uniformly. 


Now we consider differentiation. In Example 6.10, we have shown that the 


sequence { f,, : R > R} defined by f,,(”) = xe" converges uniformly to the 


function f : R — R that is identically zero. In Example 6.4, we have seen that 


the derivative sequence { f’ } converges to the function g : R > R given by 


0, ied, 
l, ife=0, 


g(x) = 


We find that 


d d 
Fe - tim fn(x) =0 which is not equal to Jim a - f(a) 1: 


Hence, even though the seqeunce of functions {f,,} converges uniformly, we 
cannot interchange limit with differentiation. 

The following theorem gives a sufficient condition for interchanging limit with 
differentiation. 
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Theorem 6.13 


Given that {f,, : (a,b) — R} is a sequence of functions which satisfies the 


following conditions. 


(i) There is a point xo in the interval (a,b) such that the sequence 


{ fn(%o) } converges to a number yo. 


(ii) For each n € Z*, f, : (a,b) + R is differentiable. 


(iti) The sequence of derivative functions {f’ : (a,b) — R} converges 


uniformly to a function g : (a,b) > R. 


Then we have the following. 


(a) The sequence of functions {f, : (a,b) + R} converges uniformly to a 


function f : (a,b) > R. 


(b) The function f : (a,b) — R is differentiable. 


(c) We can interchange differentiation and limits. Namely, for any x € 
(a,b), 


For each n € Zr", since f, : I — R is differentiable, it is continuous. 
Given a point c in the interval (a,b), let {h,,. : (a,b) + R} be a sequence 


of functions defined by 


ful@)— fl) spe ve 


a) 


Dees as) = L—C 
fle) ib ec: 
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Then h,,. : (a,b) — R is a continuous function. For any positive integers 


m and n, we have 


(fm(x) — fr(@)) = (Fm(o) = fr(©) 


: ge Se 
xL-C 


lO) = Ne) if =c. 


Applying mean value theorem to the differentiable function f,,(a) — fn(x), 
we find that for any x € (a,b) \ {c}, there is a point €, in between x and c 
such that 


hne(t) = fin(Es) — fn (Ex)- 
Thus, we find that for any x € (a,b), 
|Pm,c(®) — Mne(t)| S sup |fin(2) — fr(&)|- 
a<a<b 
This implies that 


sup |Mme(®) — hme(x)| << sup [fi,(2)— fi(2)|- (6.5) 


a<a<b a<u<b 


Since the sequence of functions {f’ + converges uniformly, Theorem 6.5 
implies that 
lim sup |f¥,(2) — f,(«)| =0. 


M,N700 ger<b 


Eq. (6.5) then implies that 


lim sup |Am (x) — 
EGOS ES) aR 


By Theorem 6.5 again, we find that the sequence of functions {h,. : 


(a,b) + R} converges uniformly. 
Now we specialize to c = Zo. Notice that by definition, 


Fn(t) — fr(%) = fro) — fn(o) + (4 Lo) (Mmao(#) — Mn,xo(#))- (6-6) 


Given € > 0, since the sequence { f,(%o)} is convergent, there is a positive 
integer N, such that for allm >n > Ni, 


| fm (0) a zo) < = 
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Since the sequence of functions {h,,..(«)} converges uniformly, Theorem 
6.4 implies that there is a positive integer N > Nj such that for all m > 
n> WN, 


leas) = 5 for all x € (a,b). 
Eq. (6.6) implies that for all m >n > N, and for all x € (a,b), 


|fm(@) — fn(X)| < |fm(®0) — fr(®o)| + |@ — Lol|Pm,eo(&) — Rn,xo(2)| 
S 
<< 5) + (b = a) x 


E 
2(b — a) 


By Theorem 6.4, this proves that the sequence of functions {f,, : (a,b) > 


R} converges uniformly. Let 


f(a) = lim fn(«) 


n—->oco 


be the limit function. Being the limit of a sequence of continuous functions 


that converges uniformly, Theorem 6.9 says hat the function f : (a,b) > R 


is continuous. 
Now we want to prove that f is differentiable and f’(2) = g(x) foreach x € 
(a,b). For any fixed c € (a,b), since the sequence of continuous functions 
{hn,-(x) } converges uniformly, it also converges pointwise. Taking n — oo 
limits in (6.4), we find that 
fee) ifx 4c, 
gla — Ihhen (a Ga 


n—-oo 


g(c), ii 


Since {h,,-(x)} is a sequence of continuous functions that converges 


uniformly, Theorem 6.9 says that the limit function h, : (a,b) — R is 


continuous. Therefore, 


hae) — ln) alin fle) = flo) 


xc xc LZ—C 


This shows that f is differentiable at x = cand f’(c) = g(c). 
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Remark 6.1 


1. In Theorem 6.13, we do not need to assume that the sequence of 
functions {f,,} converges uniformly. It is a consequence of uniform 
convergence of the sequence {f’}. The condition that there is a point 


Xo in (a,b) so that the sequence { f,,(xo)} converges is necessary. For 
otherwise if we let f,(2) = fr(z) +n for n € Zt, then f’(x) = 


f(x). But the sequence { f,,} does not converge if the sequence { f,,} is 


convergent. 


. If we assume that for all n € Z*, the function f, : (a,b) > R is 
continuously differentiable, there is an easier proof for the conclusions 
in Theorem 6.13. 


Applying Theorem 6.13 to series of functions, we have the following. 


Corollary 6.14 


Let {fn : (a,b) — R} be a sequence of differentiable functions. Assume 


(oe) 


that there is a x € (a,b) such that the series fn(xo) is convergent, and 


nl 
oo 


the series SS f, (x) converges uniformly on (a, b), then the series ye fea) 
a n=1 


converges uniformly on (a, b) to a differentiable function whose derivative 


is given by 


= se le) = ~~ ‘Lee for all x € (a,b). 
n=1 n=1 


Applying Theorem 6.13 to the sequence of partial sums {s,,(x)}. Since 
oe S- f(x) is a finite sum of differentiable functions, it is 


k=1 
differentiable. The rest follows from Theorem 6.13. 


Chapter 6. Sequences and Series of Functions 488 


Example 6.17 


Consider the series Se e~”* discussed in Example 6.13. We have shown 
n=l 


that it converges uniformly on [a, 00) when a is a positive number. For each 


me LL. {ie = —e"" is a differentiable function with derivative 
n 


Notice that 


1 
Ca) “2 for all x € [0, 00). 


(oe) 


Since the series S- aa is convergent, Weierstrass //-test shows that the 
n 


n=l 


(oe) co 1 
series ye oe — oS ae converges absolutely and uniformly on 
j=l 


[(0, 00). Corollary 6.14 shows that for any x € (a,oo), we can do term by 
term differentiation and obtain 


(6.7) 


Since a > 0 is arbitrary, eq. (6.7) holds for any x > 0. However, this is not 
true for x = 0 even if we only consider right derivatives, as the right hand 
side of the equation is divergent when x = 0. 
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Exercises 6.3 


Question 1 


co 


(a) Show that the series Mra defines a continuous function on 


m1 


(Oye: 


(b) Show that the series Sas defines 
el 


(0, 00), and for each x > 0, 


Question 2 


Let {f, : (a,b) — R} be a sequence o 


a differentiable function on 


f continuously differentiable 


functions. Assume that there is a point 9 € [a,b] such that the sequence 


{fn(xo)} converges to a point yo, and the 
(a,b) — R} converges uniformly to a function g : (a,b) > R. Use 


the fundamental theorems of calculus and 


the sequence of functions {f, : (a,b) — | 
differentiable function f : (a,b) + R, and f" 


sequence of functions {f’ : 


Theorem 6.11 to prove that 
R} converges uniformly to a 
(x) = g(x) for all x € (a, d). 
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6.4 Power Series 


In this section, we turn to consider a special class of series of functions called 
power series. The partial sums of a power series are polynomial functions. Hence, 
power series are limits of polynomial sequences. They play important roles in 


analysis. 


Definition 6.7 Power series 


A power series in the variable x is a series of the form 


Co 
3 Cn(x — Xo)”, 
n=0 


where Zo is a fixed real number, and co, c1, c2,... are the coefficients. 


co 
Each term in a power series 3 Cn(X — Xo)" is a simple polynomial c,,(” — 
n=0 


xo)" which is infinitely differentiable. However, as an infinite series, we need 


[oe] 
to address the convergence issue. Obviously, the power series >, Ce — 25)" 


n=0 
converges when x = Zo. 


Recall that in Chapter 5, we have discussed the ratio test in Theorem 5.28. 


[oe) 
Given > dy, is a series with a, # 0 for all n € Z*, let 


n=1 
ae a : a 
r =liminf | and R= limsup a 
N—0o An noo an 
CO 
Then the series > Gy 18 divergent if r > 1, convergent if R < 1, but inconclusive 
n=1 
ifr <1< R. This testis useful if the limit lim —"+") exists. For thenr = Rand 


Noo n 


we only left with finitely many points which we cannot conclude the convergence 
of the power series. Let us look at some examples. 


Chapter 6. Sequences and Series of Functions 491 


Example 6.18 


So pit 
Find the domain of convergence of the power series y aT 
n! 

n=0 


Solution 
The power series is convergent when x = 0. When x # 0, using ratio test 
nr 


: x 
with a, = —» we find that 
n! 


: An+1 
lnrate | ee 
noo An 
Therefore, the series is convergent for all real numbers x. The domain of 
convergence is R, the set of real numbers. 


Example 6.19 


lo) 
Find the domain of convergence of the power series Ss vee”. 


n=0 


Solution 
The power series is convergent when x = 0. When |x| 4 0, using ratio test 
with a,, = n'a”, we have 
An+1 


lim 


= lim (n+ 1)|z| = 0c. 
N—-+0o An noo 


co 


Hence, the series is divergent if x 4 0. We conclude that the series ye nla” 


n=0 
is only convergent when x = 0. The domain of convergence is the set {0}. 


Example 6.20 


co n 
Find the domain of convergence of the power series y = 


Gel 
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Solution 
The power series is convergent when x = 0. When x ¥ 0, using ratio test 
n 


. x 
with a, = ape have 
n 


n? n 
Sef ae nee A oh 


6 An+1 
lim 


nco] An 

Therefore, the series is convergent if |x| < 1, and divergent if |z| > 1. 

When |x| = 1, the test is inconclusive. 

(-1 
n2 


[o-e) CO 
: if : 
But we know that the series y a and the series y are 
n 


(eal HL 
n 


CO 
convergent. Therefore, the series — is convergent if and only if 
g 2 g y 
i=l 


|x| < 1. The domain of convergence is the set [—1, 1]. 


In the examples above, we apply the ratio test to determine the domain of 
convergence. This works fine when all the coefficients c, in the power series 
CO 


Ss" Cn(& — Xo)” are nonzero, or only finitely many of them are zero. We need to 
n=0 


An+1 


find the limit inferior and limit superior of the sequence { 


i where a, iS 
n 
the n" term c,,(” — 29)” in the power series. Since 


Capi (Z - 7) ale 


Cn(Z— Xo)” 


An+1 
An 


Cn+1 


d 


n 


essentially we need to find the limit inferior and limit superior of the sequence 


Cn+1 \ 


Cn n 


exists, the limit inferior and limit superior of this sequence are the same, and the 


Cn+1 


i then multiply by |x — zo|. If the limit of the sequence 


domain of convergence can be determined up to the end points of an interval. We 
apply other convergence test to check the convergence at these end points. 
There are two problems with using the ratio test for determining the domain 


of convergence. 


Cn+1 


1. If the limit inferior and limit superior of the sequence { 


\ are not the 


rr 
same, the ratio test is inconclusive for x in an interval. 
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co 


2. When infinitely many of the coefficients c,, in the power series > Cn(Z— Xo)” 


are zero, the ratio test cannot be applied. This problem can be citoumvented 
if there is some patterns on the indices n for which c,, is 0. For example, if 
Con = 0 for all n € Z™, the series only contains the odd terms, and it can be 
written as 


CO 
LS Con—1(@ — )?"*. 
n=1 


In this case, we can apply the ratio test with a,, = Con_1(« — 20)” |. However, 
the first problem might still be present. 


To resolve these problems, we find that the root test (Theorem 5.27) is better 


from the theoretical point of view. Given a series ye Ay, let 


n=1 
p =limsup V/|ay|- 
Noo 


[oe] 
The root test says that the series S- ay is convergent if p < 1, divergent if p > 1, 


n=1 


and inconclusive if p = 1. 


Applying the root test to a power series, we have the following. 


Theorem 6.15 Convergence of Power Series 


CO 
Given a power series y Cn(x — Xo)”, let 


n=0 


p =limsup ¥ |cn|- 
Noo 


. If p = 0, then the power series converges for all real numbers zx. 
. If p = ~, then the power series only converges at the point x = Zo. 


. If pisa finite positive number, let R = 1/p. Then R is a positive number. 
The power series is convergent for all x satisfying | — x9| < R, and 
divergent for all x satisfying |a — xo| > R. 
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Proof of Theorem 6.15 


Co 
For the power series ye Cn(x — %o)”, the n™ term is ay = cp(x — Xo)”. 


n=0 


p =limsup VY |a,| = |2 — xo| limsup V/|cp| = p|x — xo}. 
N—->0o N+ Co 


Now we apply root test as stipulated in Theorem 5.27. 


1. If p = O, then p = O, and so the power series converges for all real 


numbers x. 


. If p = ow, then p = oo if x # xq. Hence, the power series is divergent if 
x # xo. Therefore, the power series only converges at the point x = Xo. 


. If pis a finite positive number and R = 1/p, then when |x — xo| < R, 
p= tile = Ro — | when |e — 7) i o— |e —7i\e = hp — I 
Therefore, the power series is convergent when |x — xo| < R, divergent 
when |x — xo| > R. 


Corollary 6.16 


[o-e) 
Given a power series SS Cn(x — Xo)" such that c,, # 0 for all n, assume 


. . n=0 
that the limit 


, Cn4+1 
rea 
n—00 | Cy 


exists in the extended sense. 
1. If p = 0, then the power series converges for all real numbers 2. 
2. If p = oo, then the power series only converges at the point x = Zo. 


3. If pis a finite positive number, let R = 1/p. Then PR is a positive number. 
The power series is convergent for all x satisfying |x — xo| < R, and 
divergent for all x satisfying |a — x9| > R. 
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By Theorem 5.26, we find that lim aa 


N—->Co 


exists implies that 


Cn 

5 os aS : Cn+1 

limisup </|¢,)— lim <7, | — lim 
n— oo nN—- Co n—0o Cn 


The rest follows from Theorem 6.15. 


Domain of Convergence 


Theorem 6.15 shows that the domain of convergence of a power series 
centered at x can only be one of the following cases: 


1. De 
By (Xo = R, Xo + R) 4. [zo = R, f6) oar R) 
5. 6. 


(zo —R, zo +R] [zo — R, xo + RI 


Here F is a positive number. 


Definition 6.8 Radius of Convergence 


co 
Given a power series y Cn(x — Xo)”, let 
n=0 


p =limsup VY |cp| 
Noo 


as an extended real number. Then p > 0. Let R = 1/p in the extended 
sense. Namely, R = oo if p = 0, and R = 0 if p = oo. This number R 


is called the radius of convergence of the power series SS Gle =a)" 
n=0 


The power series is convergent when |x — x9| < R, and divergent when 
|x — xo| > R. 


Let us look at the following example. 
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Example 6.21 


Let {c,,} be the sequence defined by 


if n is even, 


if n is odd. 


co 


Find the domain of convergence of the power series y Ce 


(al 


Solution 
Notice that 
n+], if n is odd, 


if n is even. 


Applying ratio test with a,, = c,x", we find that if « 4 0, 


Qn+1 Cn+1 


lim inf = |2| lim inf =" 
n—co hay n—-0co Cn 


‘ : Cn+1 
lim sup = |x| lim sup ec 


An+1 


This shows that the ratio test is inconclusive for any x except x = 0. 
Let us turn to root test. By (5.4), we have 


lin 7 — 


N—>Co 


This implies that 


Tinie Ae, | — le 
n—- co 


co 


Therefore, the power series Se Cyx" is convergent when |2| < 1, divergent 


| 
ee) 


when |x| > 1. When x = 1 or —1, we have the series SO ceNe: Since 


n=0 
lim c, 4 0, we conclude that the power series is divergent when x = 1 or 
NCO 


x = —1. Hence, the domain of convergence of the power series is (—1, 1). 
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This example shows that applying ratio test naively will leads to inconclusive 
scenario, but the root test has rescued the problem. In practice, we always want 
to avoid applying the root test because it is difficult to find the limit superior of 
the sequence {/len| } when the coefficients c,. In the example above, we can 
avoid using root test by writing the power series as a sum of two power series, and 
apply the ratio test to the two power series separately. In any case, the root test 
has given a theoretical decisive conclusion about the possible types of domain of 
convergence for a power series. 

For a power series whose radius of convergence F is 0, it only converges at 
a single point x = xo. So there is no point to consider such power series. If the 
radius of convergence F of a power series S- Cn(x — Xo)" is positive, the power 


n=0 
series defines a function on the open interval (x7) — R, x9 + R). We want to study 


the continuity, differentiability and integrability of such a power series. Therefore, 
we need to determine whether the power series converges uniformly. 
(oe) 


Unfortunately, in general, a power series d Cn(x — £0)" does not converge 


=0 
uniformly « on the interval (2p — R,x%o + R). For example, consider the series 


s(x - yo x". In Example 6.7, we have seen that 3 x" is convergent when 
n=0 
(ae) = 1, nd divergent when |z| > 1. Hence, its radius of convergence is R = 1. 


When |x| < 1, the power series 3 x” defines the function 


The n" partial sum of the series is 


_— gntl 
r(z) =1 i ge 
Sax) Se ee eee ae jon 
Therefore, when x € (—1, 1), 
1 _ gntl ntl 


Since 
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we find that 
sup |s(2) — S,(x)| = oo. 
ja|<1 
Hence, the series > x" does not converge uniformly on (—1, 1). However, if a 
n=0 


is anumber such that 0 < a < 1, then for |x| <a, 


ntl qrtl 
1-2 l-a 
Therefore, 
qrtl 
ae Is(x) — 8n(z)| S 


This implies that 


Hence, the series y x" converges uniformly on |—a, a]. 
n=0 


A general power series also have similar behavior. 


Theorem 6.17 Absolute and Uniform Convergence of a Power Series 


lo) 


Given that SS Cn(Z — Xo)” is a power series whose radius of convergence 
n=0 
R is positive. If Ry is any number satisfying 0 < R, < R, then the power 
co 
series SS Cn(x — Xo)” converges absolutely and uniformly on the set D; = 


n=0 
4 |\\ae =| Ay 


R+R, 


Let R, = ae Then R, < Ry < R. Hence, the series yD Cn(Z— Lo)” 


n=0 
oo 


is convergent when |x — xo| = Ro. Let x2 = 29 + Ro. Then Se Cn(L2 — 


n=0 


(oe) 
— SS C, RF is convergent. This implies that iim (Go fais == (0), 


n=0 
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In particular, the sequence {c,, R35} is bounded. Let MW be a positive number 
such that 
be S| Se for all n > 0. 


We apply the Weiertrass \/-test (Theorem 6.8) with f,,(”) = c,(a — x)”. 
We find that 


R nm 
\en(% — 20)"| < |e,|RY < M (3) = Mr” when |x — 2%o| < Ry. 
2 


Co 
Here r = R,/Rp. Since 0 < r < 1, the geometric series Sr” 
n=0 
co 


is convergent. By Weierstrass /-test, the power series a Cn(X — Xo)” 


n= 
converges absolutely and uniformly on the set D; = {x | |x — a%o| < Ry}. 


Remark 6.2 Radius of Convergence Revisited 
In the proof of Theorem 6.17, essentially we show that if the power series 
(oe) 
oe Cn(%— Xo)” is convergent when x = Xo, then it is convergent for all x in 
eee (to — Ro, 2 + Re), where Ry = |x_ — Xo|. The contrapositive 
[oe] 


of this statement says that if the power series Ss Cn(X — Xo)” is divergent 


n=0 
when x = 23, then it is divergent for all x satisfying |2 — x9| > Rs, where 
R3 = |x3 — Xo|. Hence, if S is the set 


[oe] 
s= {in — %o| ys Cn(x — Xo)" is convergent when xz = x1 : 


n=0 


then S contains only nonnegative numbers. Obviously, 0 is in S. If R, is in 
S, any positive number r that is less than R, is also in S. This implies that 
if R = sup S, then [0, R) C S and (R, ov) is disjoint from S. This provides 
an alternative way to define the radius of convergence of the power series 
without using the root test. Namely, the radius of convergence R is defined 
as the supremum of the set S. 
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From Theorem 6.17, we obtain the following. 


Theorem 6.18 Continuity of a Power Series 


lo-e) 
Given that y Cn(Z — Xo)” is a power series whose radius of convergence 


n= 


0 
Ris positive. It defines a function 


ee ye Cn(Z — Xo)” 


that is continuous on the set D = {x | |x — x9| < R}. 


Given any 7} € D = {a||x—2|< R}, Ry = |x, — xl < R. 
Theorem 6.17 says that the power series converges uniformly on the set 
D, = {x||x — x0| < Ri}, which contains the point x}. 

For n > 0, the function f,(2) = cy(x — xo)" is continuous. By Corollary 


6.10, the power series Se Cn(& — Xo)" is continuous at x = 71. 


n=0 


The next is about term by term integration of a power series. 


Theorem 6.19 Term by Term Integration of a Power Series 


(oe) 
Given that y Cn(a% — 2%)” is a power series whose radius of convergence 


n=0 


R is positive. If [a,b] is a closed interval that is contained in the interval 
(xo — R, xo + R), then the function 


f(a) = J en(w — a0)” 


is Riemann integrable on |a, b], and we can integrate term by term. Namely, 


b b oo b 
/ ei — / Ss CAL — ao) ar — i =) (x —20)"dx. (6.8) 
Gl a n=0 n=0 @) 
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Let R; = max{|a— |, |b—2x0|}. Then 0 < R, < Rand {a, b] is contained 


in [xo — Ri, xo + Ri]. By Theorem 6.17, the power series Sy Cn(Z — Xo)” 
n=0 
converges uniformly on [xo — Ry, v9 + Ry], and hence on [a, b|. For any n > 


0, the function f,,(”) = cn(x — Zo)” is Riemann integrable. By Corollary 


6.12, the function f(x) = S- Cy(a — xo)” is Riemann integrable on [a, b] 
n=0 


and (6.8) holds. 


Before we discuss term by term differentiation, we need to prove the uniform 
convergence of the derivative series. We will first prove the following lemma. 


Lemma 6.20 


Given that {a,,} is a sequence of nonnegative numbers, 
lim sup (%/na,) = lim sup ay. 


N+ Co n—>Cco 


For all n € Z*, «/n > 1. By (5.4), we have dim Wn = 1. Hence, given 
€ > 0, there is a positive integer N such that for : all tN, 


1< Yn<lte. 
Therefore, for all n > N, 
Gn Ut Cin (1+ eé)an 


This implies that 


lim supa, < lim sup (Vn Gn) < (1+ ¢)limsup ap. 


n—->co Nn—->Cco N—- Co 


Since € can be any positive number, we conclude that 


lim sup (¥/na,) = lim sup an. 


N+ Co n—->oo 
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Theorem 6.21 


co 
Let y Cn(x — Xo)” be a power series with a positive radius of convergence 
n=0 
co 
n-1 


FR. Then the radius of convergence of the derived series SS NCn (x — Xo) 


n=l 


is also R. 


oe) 


Let R’ be the radius of convergence of the derived series NCy\L—X 
g 
nal 


It is not difficult to see that it is the same as the radius of convergence of 
co 


n—-1 


the series SS NCp(Z — Xo)”. By Lemma 6.20, 


n=1 


= —imisip 4/7 eq | — Hs WANes| = 


n—- co 


This proves that R’ = R. 


Notice that if k € Z*, 
a® rt n—-k 
agk & ~ £0) =n(n—1)---(n—k+1)(a@ — 2x)”. 
By induction, we can deduce the following. 


Corollary 6.22 


co 

Given that y Cn(Z — Xo)” is a power series whose radius of convergence 
n=0 

R is positive. For any k € Z™, the series 


So n(n —1)-- “(y= bE 1)e.(¢ — a5)" * 
n=k 


has radius of convergence R. 
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The & = 1 case, which says that the series SS NCn (x — 29)" | has radius of 


n=1 
convergence RF, is given by Theorem 6.21. Applying Theorem 6.21 to the 


series Ss NCp (x —29)”" *, we find that the series SS nm(n—1)é,(a—Z9)" - 


n=1 n=2 
also has radius of convergence R. This is the statement we need to prove 
for the k = 2 case. For general k € Z*, we proceed by induction. 


The next theorem says that we can differentiate a power series term by term. 


Theorem 6.23 Term by Term Differentiation of a Power Series 


[oe) 


Given that y Cn(Z — Xo)” is a power series whose radius of convergence 


n=0 
Fis positive. Then the function 
f(z) =) cna — 20)” 
nv 


is differentiable on (1p — R, x9 + R). When x € (4% — R, x) + R), we can 


differentiate the power series SE Cn(x — Xo)" term by term to obtain 


n=0 


d [o-@) [o-e) 
fe) = re SS Cle — wg)? = Ne NCp(x — Zo)". (6.9) 
n=0 n=1 


By Theorem 6.21, the radius of convergence of the derived series 


SO ae: —2x9)"' is also R. By Theorem 6.17, the series Sree — 
n= 


ic 


x9)" ' converges absolutely and uniformly on [9— Ri, 79 + Ri] if R, < R. 
Given 2; € (% — R,xp + R), |z1 — to| < R. Choose R, such that 
|v1 —Xo| < Ry < R. Then x; € (ap — Ri, %9 +R). Corollary 6.14 implies 
that the function 


Chapter 6. Sequences and Series of Functions 504 


f(a) = > en(w — a0)” 


is differentiable on (a9 — R,, 29 + R,), and we can perform term by term 
differentiation to obtain (6.9). Since x; is any point in (%) — R, xo + R), 
this proves the statement of the theorem. 


By induction, we have the following. 


Corollary 6.24 


(oe) 


Let y Cn(Z — Xo)” be a power series with a positive radius of convergence 


n=0 
R. Then the function 
(Oy cea 
n=0 


is infinitely differentiable on (x) — R,x + R). For any k > 1 anda € 
(Xo = R, XO =P tye 


f(x) = Sale = 1) she (n =e L)en(x om eee 


n—K 


In particular, 


Let us summarize what we have learned about power series. 


Functions Defined by Power Series 
[oe] 
A power series y Cn(x — Xo)" is convergent when x = 2p. If the series is 


n=0 


convergent for some x; # Zo, then it has a positive radius of convergence 


R. The series is convergent for all x satisfying |~ — x9| < R, and divergent 


for all x satisfying |x — xo| > R. 
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The power series defines a function 
f(z) =} 0 en(x — 20)” 
n=0 


on the interval (v9 — R,xz + R). This function f(x) is infinitely 
differentiable, and we can perform term by term differentiation and term 
by term integration. 

Functions that are representable by power series are called analytic 
functions. Their domains can be naturally extended to complex numbers. 
This is the main topic that is discussed in a course in complex analysis. 


Definition 6.9 Power Series Expansion of a Function 


co 
If a power series y Cn(x — 20)” has positive radius of convergence R, it 


n=0 


defines an analytic function f : (v7) — R, xo + R) > Rby 


(ea ae — 20)”. 


(oe) 
We say that y Cn(Z — Zo)” is a power series expansion or power series 


n=0 


representation of the function f(z) on the interval (7p — R, x + R). 


Example 6.22 


1 

When |x| < 1, the function f(x) = cae has a power series expansion 
—£ 

given by 


1 


n=0 


Applying term by term differentiation to (6.11), we obtain the following. 
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Theorem 6.25 


Let k be a nonnegative integer. Then for |x| < 1, 


i 
(1—x)Bt1 


(6.12) 


n(n—1)---(n—k+1) 


a are the binomial coefficients. 


The & = 0 case is just the formula (6.11). By Corollary 6.24, we can 
differentiate term by term / times and (6.10) gives 


k! = 
(=e ee when |x| < 1. 


n=k 


Dividing by k! on both sides gives (6.12). 


The formula (6.12) is very useful. It has applications in probability theory. 


Example 6.23 


In probability theory, a geometric random variable is a random variable 
X that depends on a parameter p where 0 < p < 1. If one performs a 
series of identical and independent Bernoulli trials, each has a probability 
p to be a success, then X is the number of these Bernoulli trials need to be 


performed until the first success occurs. For any n € Z*, the probability 


that X is equal to n is 


Chapter 6. Sequences and Series of Functions 507 


The expected number of Bernoulli trials need to be performed until the first 


success 1S 


fo) 


Using (6.12) with k = 1 and x = 1 — p, we find that 


Dp 1 
2) S=pyp 


The variance of X is given by Var (X) = E(X?) — E(X)?. To find this, 
we compute £(X°) first. 


= Soe Pa =) =p) n(1—p) - 


Using (6.12) with k = 2 and x = 1 — p, we find that 


=) n(n —-1)(1-p ee) 
nl 

ile 1 

( au Bs 

p p 


Therefore, the variance of X is 


Var (X) = E(X?) — 


1 
Recall that the logarithm function f(x) = In x is defined so that f’(a) = —. 
x 
This gives 


d 1 
—In(1 = 
dx ne) toa 


Using term by term integration, we can obtain power series representation for the 


logarithm function. 
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Theorem 6.26 Power Series Expansion of Logarithm Function 


ee n 
x, 
For |x| < 1, the power series y (—1)""'— is convergent and 
n 


y=] 


(oe) 


In(l+2) = 5 (-1) 


i= 


2 3 


ae a6 
eee a} 
n ss ae + ( ) n 


n n 
mee le 


eee 


Given any x, with |xz,| < 1, let Ry = |2,|. Since the geometric series 
Co 


SS x” has radius of convergence 1, Theorem 6.19 says that we can integrate 


n=0 
(6.11) term by term over the interval with 0 and x, as end points. 


This gives 


Replacing x; by —2, we find that if |x| < 1, then 


co 


The theories that we have deveoped so far do not allow us to take the limit 
x —> 1” term by term on the right hand side of (6.13). However, we can go 
around this problem in another way. 


Example 6.24 


Show that 


(6.14) 
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Solution 
Notice that if 2 4 —1, then for any n € Z*, 


ele OE 


it ie Dees) Pres =i n-1 ae a = 
wtau*—a“?4+-+-+(-1)" ar oe ee 


Each of the functions is continuous on [0, 1]. Therefore, 
1 
| (l-a+a?-—2°4+---+(-1) 
0 


-{7 
fo Ite 


This gives 


when 0 <2 <1. 


Therefore, 


1 gt 1 1 
|R,,| < / —— avs f C= ————, 
0 1l+2z 0 n+l 


This implies that lim R,, = 0. Thereofore, 
noo 


eve st (Sr 
{= =, ae a — li i l Db 
Nn ees ate k io 


Next, we give the power series that represents the exponential function. 
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Theorem 6.27 Power Series Expansion of Exponential Function 


For any real numbers x, 


ies n 
We have shown in Example 6.18 that the power series y —, is convergent 
n! 


n=0 


for all real numbers x. Corollary 6.24 says that it defines an infinitely 
differentiable function f : R > R by 


a 


n=0 


From this, we have f(0) = 1. Term by term differentiation gives 


lee) 


Se = flo 


Then we find that 
g(x) =e" f'(x) —e f(x) =0. 
This shows that there is a constant C’ such that 


C—O for allz € R. 


Set x = 0, we find that C = g(0) = e® f(0) = 1. Hence, e~* f(z) = 1 for 
all real numbers x, which implies that f(a) = e* for all real numbers zx. 


Now we want to return to address an existence problem in Chapter 3. In 
Theorem 3.32, we claim that there is a twice differentiable function f(x) that 
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satisfies the equation 
f"\(x) + f(z) =0 


and the initial conditions 


We define this function as sin x. We can now prove the existence. This is actually 
the power series method for solving differential equations. Assume that f(a) can 


be written as a power series 


{@)= S- Cr ia 
n=0 


Then f(0) = 0 and f’(0) = 1 implies that co = 0 and c, = 1. Differentiate two 


times, we have 


cee Si n(n eg? = Si(n + 2)(n + 1)en422”. 
n=2 n=0 


Substitute into the equation f” (x) + f(x) = 0, we find that 


[(n + 2)(2 + Leng + Cn] 2” = 0. 
n=0 
Hence, we find that if {c,,} is defined recursively by cp = 0, c, = 1, and for all 


n> 0, 
Cn 


n+ 1)(n +2)’ 


we get a candidate solution for our problem. The recursive formula for {c,,} can 


Cn4+2 = ~( 


be easily solved to give 


(-1)"" 


= _ + 
Con—-1 = (On 1)!’ Con = O foralln € Z". 


Now we are left to justify this is indeed the solution to our problem. 
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Theorem 6.28 
The power series 


co 


eae 2n— 
ile as 


(— 
(2n 


il 


defines an infinitely differentiable function f : 


f"(x) + f(z) = 0, 


First, we need to show that the power series is convergent everywhere. We 


=i n-1 
ia 2"! Then if x # 0, 


can use the ratio test with a,, = —————— 
(2n — 1)! 


= x" lim — 0 
noo Qn(Qn +1) 


This shows that the power series is convergent for all x € R. By Corollary 
6.24, it defines an infinitely differentiable function f : R > R, 


(2n — 1)! 

al 

From here, it is straightforward to find that f(0) = 0. We can differentiate 
term by term to obtain 


; ih 
I a aa = 


He) a (2n _ Hen = ee 


i ae Sel os a 
Qn—3) = La i 


nl 


This proves that f(x) + f(x) = 0, and thus the proof is completed. 
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As a byproduct, we obtain the power series expansion for the functions sin x 


and cos x. 


Theorem 6.29 Power Series Expansion of Sine and Cosine Functions 


For any real numbers x, 


The power series for cos x is obtained by term by term differentiating the 
power series for sin x. 

Finally, we want to consider the multiplication of two power series. Given that 
p(x) and q(x) are polynomials of degree k and / respectively, with 

p(x) =agptayxr+---+ayx" and g(r) = bo tdyx+---+ he". 
The product p(a)q(x) is a polynomial of degree k + 1, with 
p(x)q(x) = cg +ee +--+ + crye*t 

= (agbo) + (agb, Tr ab9)x <p ese a,b t, 


For 0 <n < max{k, |}, we find that 
Ch = aon =le a4Dn—1 eal Oy 101 =i Ando = y Chin crees 
m=0 


This motivates the following. 


Definition 6.10 Cauchy Product of Two Series 


[o-e) CO 
Given the two infinite series ye Gn, and Ss b,, their Cauchy product is 


n=0 n=0 
[oe) 


the infinite series y Cn, where 


n=0 
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The following theorem is a special case of the Merten’s theorem on Cauchy 


products. 


Theorem 6.30 Term by Term Multiplication of Power Series 


[o-e) (oe) 
Let SS, An(X — Xo)” and s bn (x — 29)” be two power series with positive 
n=0 n=0 


radii of convergence FR, and R, respectively. Define the sequence {c,}°°5 
by 


n 
= SS Gen Ona 
m=0 
(oe) 
Then the power series se Cn(x — Xo)” has radius of convergence R > R., 


n=0 


where R, = min{R,, Ry}. If 


f(t) = J en(e—ao)", g(x) = D> an(e—a0)", (0) = D> balw—a0)” 


are the functions defined by each of the power series on (% — R.,%) + R-), 
then we have 


Without loss of generality, assume that xp = 0. 
It is suficient to prove that for any x, satisfying 0 < R, = |x,| < R,, the 
co 


series y Cnx} 1s convergent, and it converges to AB, where 


n=0 


[o.e) (oe) 
A= y Ants, a y Dat. 
n=0 n=0 


This would imply that the series Se is convergent on (—R,, R.), 


n=0 


which proves that its radius of convergence RF is at least R.. 
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Take an Ry such that Ry < Ro < R,. Then Ro < R, and Ry < R,. Using 
the same reasoning as in the proof of Theorem 6.17, we find that there is a 


positive constant / such that 
Kae | Ve Sand Onc Wine for all n > 0, 


where r = R,/Rz is a number satisfying 0 < r < 1. 
For a positive integer n, let 


n n n 
C= SS ck, JA = Ss a,x’, = Se bat 
k=0 k=0 k=0 
be the partial sums of each series. For any n € Z*, 


= a oe M n+1 
1B Bul =| So met] < So oct] < So et = ME 


k=n+1 k=n+1 k=n+1 


By definitions of the sequence {c,,}, we find that for n € Z*, 


n I n n 

Y > l > > ; l-k 

Ga = Apdi_-KXy = Apr, esas 
l=0 k=0 k=0 l=k 


n-— 


n 
1 k 
1L1 = ) Gets np 
k=0 


Therefore, for any n € Z", 


Mrr- 1 


ICn — BAn| < S— \axet||B — Bre] < 55 Mr* x ; 
k=0 k=0 ae 
2 


M 
es ale +1)r"*1, 


By Theorem 5.29, lim (n + 1)r"*! = 0. By squeeze theorem, we find that 
Noo 


him G,— 6 lim A, — AB, 
n—-Cco 


Noo 


which completes the proof of the theorem. 
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Let us look at an example. 


Example 6.25 


Consider the function f : R — R defined by f(x) = e* sin. Find the 
power series expansion of f(x) up to the x° term, and find f)(0). 


Solution 
We know that 


ee A 98 
ee __ —§=—. eee ] 
e => 5 for all x € 1] 
n=0 
[o-@) 


ne — S°(-1)" 1] x . forallz € R. 


nl 


By Theorem 6.30, 


GP 0 t 
e sinz = (1+24 5 


7 4 


_ 2 
=@+u4 Ty Ye 

x ae 
3 3 


This gives the power series expansion of f() up to the x° term. From this, 
we find that 


7) 3) ( 
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Exercises 6.4 


Question 1 


Let p be a positive number. Determine the domain of convergence of the 


co x” 
power series S —. 
nP 

n=0 


Question 2 


Show that when |x| < 1, 


Question 4 


Find a closed form formula for the sum of the series Se n°x” when |x| < 1. 
n=1 
Question 5 


Consider the function f : R — R defined by f(x) = e* cosa. Find the 
power series expansion of f(a) up to the x° term, and find f°) (0). 


Chapter 6. Sequences and Series of Functions 518 


6.5 Taylor Series and Taylor Polynomials 


In Section 6.4, we have seen that the exponential function, logarithm function, sine 
and cosine functions have power series representations that are valid on its domain 
or a subset of its domain. Power series are limits of sequences of polynomials. 
They are infinitely differentiable, and they can be differentiated term by term 
and integrated term by term. Thus, they are very useful. Hence, we can ask 
the following two questions. 


1. If J is an open interval that contains the point xp, and the function 


f : I — Ris infinitely differentiable on J, does there exist a positive 
co 


constant R and a power series SS Cn(Z — 2)” such that 


n=0 


es = Sa — Xo)” when |x — Xo| < R. 
n=0 


2. If the power series expansion exists, what is the error when we 


approximate f(x) by the partial sum s,,(7) = 7 C(e— ay)? 
k=0 


For the first question, Corollary 6.24 says that if such a representation exists, 
then we must have 


f™ (a9) =nlen for all n € ZT. 


This leads us to the following definition. 
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Definition 6.11 Taylor Series and Maclaurin Series 


If J is an open interval that contains the point xo, and the function f : J - 


R is infinitely differentiable on J, the Taylor series of f(x) at xo is the 


series 


2 £(0) (a5 , ) (a5 
pg el) ( Meee = 8G Care eee (0) 


a oar cae 


n=0 


When zo = 0, the Taylor series at 0 is also called a Maclaurin series. 


Here the Taylor series is defined as a power series as long as the function is 
infinitely differentiable in an open interval J that contains the point x». We do not 
assume any convergence. Even though the Taylor series is convergent, we cannot 
assume that it converges to the function f(z) itself. In Section 6.6.3, we are going 
to see a classical example of an infinitely differentiable function whose Taylor 
series converges but to a different function. 

Nevertheless, for functions that are defined by a power series centered at xo, 
Corollary 6.24 gives the following. 


Theorem 6.31 


[o-e) 
Assume that the power series eG — Xo)" has positive radius of 


n=0 


convergence R. If f(x) is the function defined by the power series 


ye Cn(Z — Xo)” on the interval (x9 — R, xo + R), then the Taylor series 


n=0 
oo 


of f(x) at xo is Se Cn(x — 20)". Namely, 


n=0 


Hee ye: when x € (% — R, x + R). 


n! 


n=0 


This shows that the Taylor series of f(a) converges to the function f(z). 
It also says that the power series expansion of a function at a point po, if 
exists, is unique, which is the Taylor series of the function at xo. 


We have the following list of Maclaurin series from Section 6.4. 
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Useful Maclaurin Series 


giS=lt+g+a°?+e°+--- when |z| < 1. 


Dy 3 


£ 4b Mb : 
5 Say yp ty ; 


x 
mi 


+--+ forallz € 


—+--- forallze 


= + +++ when |x| < 1. 


Remark 6.3 Maclaurin Series for Odd Functions and Even Functions 


Let a be a positive number and let f : (—a,a) — R be an infinitely 
differentiable function. Since the derivative of an odd function is even, 
and the derivative of an even function is odd, the following holds. 


1. If f(x) is an odd function, the Taylor series of f(x) at 2 = 0 has the 


form 


— fe (0) an—1 
(2n — 1)! , 


n=!) 


which only contains the odd power terms. 


2. If f(x) is a even function, the Taylor series of f(x) at x = 0 has the 
form fs 
oe 2n)(Q) 
és if ( ) en 
n=0 
which only contains the even power terms. 


By the uniqueness of power series expansion asserted in Theorem 6.31, and 
the results proved in Section 6.4, we can use term by term addition, multiplication, 
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differentiation and integration to obtain the power series for new functions from 
old ones. This is a useful tactic to find Taylor series of a large class of functions 
from the few elementary ones listed above. 


Example 6.26 


eae I. 
———= 61 = 0. 
ae aoe 
and find the largest open interval where this series is convergent. 


Find the power series expansion of the function f(x) = 


Solution 
Applying the formula 


7 = a 
ae i(1+ 5) 


Multiply by 1 + x, we find that when |x| < 2, 


The largest open interval where this series is convergent is (—2, 2). 


Example 6.27 


R be the function defined by 


eet it 0: 
; if 


Show that f is infinitely differentiable, and find f (n) (0) for alln > 0. 
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Solution 


For any real number 7, the series 


3 5 o 


XL 4 bs XL 
PE) cee pea Poms LER 
pa ee ol Sa 


n=1 
converges to sinx. When x # 0, dividing by x, we find that the series 
2n—2 2n 
ae ik = 
2) 


gen 


. [o-@) 
sin X 
converges to ——-. Therefore, the power series y (—1)"——__ 
He 


= (2n + 1)! 
converges for all x, and when x # 0, it is equal to f(x). When x = 0, 
it has value 1, which is equal to f(0). This proves that 


EW eo for all x S 


n=0 


Since the function f(z) has a power series expansion that converges 
everywhere, it is an infinitely differentiable function. From the power series 
expansion, we find that 


—1)" 
(2n+1) = (2n) = ( f ll > 
i oy 0) f= (0) Sato or all n > 0. 


An important power series expansion that cannot be derived from the list of 
Taylor series for elementary functions is the binomial series. Recall that if n is a 
positive integer, the binomial expansion of (1 + x)" is given by 


(l+2)"= 2 Gr 


If n is a negative integer, let m = —n — 1. Then m is a nonnegative integer. By 
Theorem 6.25, we find that when || < 1. 


(l+2)"= esau = 3 (*) (—x)*-™ = si-ve(" rn) wk, 


k=m k=0 
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Notice that for k > 0, 


-ae(* : ”) pe) 


a klm! 
= (yt Bn 1)---(m4+1) 
= (—m — 1)(—m — 2)---(—m —k) 
ks 
— n(n-l)---(n-k+1) 
7 kl 


Thus, when n is a negative integer, we find that (1 + x)" has a power series 
expansion on the interval (—1, 1), which can be written as 


(1+2)"= 
k=0 


n(n —1)---(n-k+)) 5 
k) : 


This motivates us to extend the definition of the binomial coefficients. 


Definition 6.12 Generalized Binomial Coefficients 


For any real number a and any nonnegative integer k, we define the 


generalized binomial coefficient @ by 


and for k > 1, 


Example 6.28 


Let a be a real number. Show that the Maclaurin series of the function 
f:(-1,) -R, f(z) =(1+2)* is 


When a is not a nonnegative integer, show that the radius of convergence 
of this power series is 1. 
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Solution 
The function f is infinitely differentiable. By straightforward computation, 
we have 
f™(e) =a(a—-1)---(a—k+)042)%*. 


This gives, 
f®™(0) = a(a—1)---(a—k+1). 


Therefore, the Maclaurin series of f is 


ses Se 


0 


lo“) 
= 


For the radius of convergence, we note that 


a= (2 a(a—1)+++(a—k +1) 


k; k} 
is nonzero for all & > 0 when a is not a nonnegative integer. Thus, we can 


apply ratio test. Since 


we find that the radius of convergence of the power series is 1. 


In the example above, we have shown that the Maclaurin series of f(x) = 
(1+ x)* is Si & a", which is a power series that converges on (—1,1). But 
k=0 


we have not shown that the Maclaurin series converges to f(x) on (—1, 1), except 
when a is an integer. To prove the convergence of the Maclaurin series to the 
function, we will study the convergence of the sequence of partial sums. 

The partial sums of Taylor series are called Taylor polynomials. They are 
important in their own right. 
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Definition 6.13 Taylor Polynomials 


Let J be an open interval that contains the point xo, and let n be a positive 


integer. If the function f : J — Ris n times differentiable on J, the nih 


Taylor polynomial of f(a) at xo is the polynomial 


2 AO lay ; 
i > u = le — Zp) 


In particular, 


Ti(x) = f(xo) + f’(x0)(% — 20), 


s(x) = f(20) + f'(00)(2 — a0) + 2) (a — ao)? 
s(x) = fl20) + F'(o)(0 — 20) + 22 (w — ng)? + 1 (@ — a0) 


and so on. 

Notice that to define Taylor polynomials of degree n for a function f, we do 
not need to assume that f is infinitely differentiable. We just need to assume that 
f is n times diferentiable. 


Example 6.29 


For the function f(z) = x cos, its Taylor series is 


and so on. 
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In this example, we notice that T>,_ (2) = T>,(x) for alln € Z*. This is 
because f(x) is an odd function. 
We have noticed that the first Taylor polynomial 


T(x) = f (xo) + f'(x0)( — 20) 


of a function f(x) at x = Zo is related to the tangent line to the graph of the 
function. In fact, by definition of derivatives, we have 


on [OAM _ yy Fe) = Feo) — (e = 20) F(a) 


LX vr Xo LX LG = oT) 


= 0. 


We say that 7) (2) is a first order approximation of f(a) at x = xo. In general, we 
can define the following concept. 


Definition 6.14 Order of Approximation 


Let J be an open interval that contains the point xo, and let n be a positive 


integer. We say that two functions f : J + Rand g: I > Rare n“-order 


approximations of each other at the point xo if 


jam £() = 92) 


= (0). 
LX (ze _ a) 


We will show that the n™ Taylor polynomial of a function f(a) at 29 is an n“”- 
order approximation of the function at vo. First, we prove the following lemma 
which says that for any real number xo, any polynomial of degree n can be written 


in the form) — c,(x — 20)*. 
k=0 


Lemma 6.32 


Given a real number xo, and a polynomial p(x) of degree n, we have 


In other words, the n Taylor polynomial of p(x) is p(x) itself, and the 


Taylor series of p(x) is also p(x). 
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Let 
(G8) Stig te Oe Eee 


and let h = x — x. Then x = h+ 2. Substitute x by xp + h, we have 


p(x) = ap t+ay(h+ 2) +--- + an(h +20)”. 


For 0 < k <n, (h+ 29)* is a polynomial of degree k in h. Thus, 


ayo + ay(h +29) +--+ +an(h + 29)” 


is a polynomial of degree n in h. This implies that there are constants co, 
C1, ---, Cn such that 


le = ica = Ste: = 7)". 
k=0 k=0 
Differentiate both sides & times and set x = xo gives 
p*) (x9) = kicp. 


This proves that 


As a corollary, we have the following, which can be deduced from Theorem 
3.20, 


Corollary 6.33 


If p(x) is a polynomial of degree at most n, and there is a point xo such that 


Pita) =P Go) == = p' (He) — 0, 


then p(x) is identically zero. 


We would also like to emphasize again the following. 
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Corollary 6.34 


Let J be an interval that contains the point x, and let n be a positive integer. 


Given that f : J — Ris a function that is n times differentiable, let 


be its n™ Taylor polynomial at a9. For 0 < k < n, we have 


ee) — FF (eo): 


By Lemma 6.32, we have 


zl (x — xo)”. 


The result follows by comparing coefficients. 


Now we prove the approximation theorem. 


Theorem 6.35 


Let J be an open interval that contains the point xo, and let n be a positive 


integer. Assume that the function f : J > R is n times differentiable. 
(a) The n® Taylor polynomial 


- f® (xo) 


= i 


(x — zo)” 
k=0 


of f(a) at xp is an n™-order approximation of f(a) at xo. 
Pp 


(b) If p(x) is a polynomial of degree at most n, and p(x) is an n”-order 


approximation of f(x) at xo, then p(x) = T),(z). 
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Let us consider (a) first. Ifn = 1, we need to show that 


tm FADE) _ y, fe) = Feo) = f'@o)(# = 20) 


rx XL — Xo L>X0 v— Xo 


= 0. 


But this is just the definition of f’(xo). Assume that we have proved the 
statement for the n — 1 case. Now we look at 


sin £2) = Tal) 


I-20 ee _ cue 


This is a limit of the indeterminate form 0/0. 
Notice that 


=. f(x ae WEE PINK) Lo ‘ 
la) = So aye 0 = a2) 


is the (n — 1)" Taylor polynomial for f’, and f’ is (n — 1) times 
differentiable. By inductive hypothesis, 


PLOREHC 


xL—>x0 (x —_ gas 


= 0. 


By |’ Hopital’s rule, 


jan £0) —Inlt) _ £(@) = Ta) 


=I) 
x29 (XL — Xo)” zx N(x — Xo)! 


This finishes the induction for (a). 
Now we consider (b). Let p(x) = Ss c,(x—29)" be a polynomial of degree 


k=0 
at most n which is an n-order approximation of f(x) at a. Then 
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These give 
i 
bee (a — To)” 


It follows that for all 0 <k <n, 


Notice that 


0) (2 = a) 


Take k = 0 in (6.15), we find that co = f(x9). Then take k = 1 shows that 


: i (k) (xo) 
c, = f'(xo). Inductively, we show that c, = 71 foralO <k <n. 


This completes the proof of the theorem. 


Theorem 6.35 says that the n“ Taylor polynomial of a function f(z) at 
a point x is the unique polynomial of degree at most n which is an n®- 
order approximation of f(z) at zo. Hence, we also called T;,(x) the Taylor 
polynomial of f(z) of order n at xo. One should avoid calling it the n™ 
degree Taylor polynomial as we have seen that T;,(x) does not necessary 
have degree n. 


Given that J is an interval that contains the point x, and f : J > R is an 


n times differentiable function, the Taylor polynomial T,,(x) is well defined. By 
Theorem 6.35, 


This implies that for any <¢ > 0, there is a 6 > 0 such that (xp — 6,29 + 6) C J, 
and for all x € (xp — 6,20 + 6), 


|f(2) — Tr(@)| < ela — aol". (6.16) 


The function 
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is called the remainder when we approximate the function f(x) by its n Taylor 
polynomial T;,(x) at xo. Eq (6.16) says that when x approaches Zo, the order of 
R, (x) is smaller than the order of |x — xo|". If we assume that f has one more 
derivative, we can say more. 

We will first prove the Lagrange remainder theorem which assumes that f : 
I > Ris (n + 1) times differentiable. 


Theorem 6.36 The Lagrange Remainder Theorem 


Let J be an open interval that contains the point xo, and let n be a positive 


integer. Given that f : J — R is a function that is (n + 1) times 
differentiable, let 


be its Taylor polynomial of order n at 9. For any x € I \ {xo}, there is a 
number c € (0, 1) such that 


aS 


f(z) —T, (x) = Coan (x —2)"t', where € = 29 +c(x — 20). 


Recall that € = xo + c(x — xo) with c € (0,1) means that € is a point strictly 
between xp and x. 


The proof is a straightforward application of Theorem 3.20, which is a 


consequence of Cauchy mean value theorem. Let g : J — Rbe the function 
defined by 


- f(a) 


f(a) - )> Pe — no) 


k=0 


Then g is (n + 1) times differentiable. Corollary 6.34 implies that 


g(20) = g' (ao) = --- = g(x) = 0. 
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Applying Theorem 3.20 to the function g, we find that for any x € I\ {xo}, 


there is anumber c € (0, 1) such that 


LEO) 


where € = %9+c(x—Zp). 


Since T;,(x) is a polynomial of degree n, TL) (2) = 0 for all x € I. 


Therefore, g("*)) (a) = f+ (a) for all a € I. This concludes the proof. 


The Lagrange remainder theorem also holds in the n = 0 case. This is just the 
Lagrange mean value theorem. Thus Lagrange remainder theorem is an extension 
of the Lagrange mean value theorem. It gives useful estimates on the error term 
in approximating a function by its Taylor polynomial, especially if f+) (2) is 
always positive or always negative in a neighbourhood of xo. 


Example 6.30 


In this example, we demonstrate how we can use the Lagrange remainder 
theorem to show that the Taylor series of the function f : R > R, f(x) = 


e”, converges to f(x) for all real numbers x. The n" Taylor polynomial of 
f(ol=e* ate = Us 


Since f(x) = e” for any n € Zt, Lagrange remainder theorem says that 
for any n > O, for any real number x ¥ 0, there is a number € strictly 
between 0 and x such that 


ee) ef 
TGs) = =r = aes 6.17 
oan (nt)! eo 
For fixed x, € depends on n but we can use € < |z| to get the estimate 


e§ < el*! that is independent of n. This implies that 


rn feelers 


(n+ 1)P 


|e” — T,,(x)| <e 
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We have proved in Example 6.18 that the power series Se Be is 
nN: 


n=U 
Leelee 


convergent. Therefore, lim = 0. This allows us to conclude 


noo (n+ 1)! 


that 
2, n 


ete Minas (Cry Weer ree el eee (6.18) 
This is an alternative way to prove that the Taylor series of e” converges 
to e”, instead of the aproach used in the proof of Theorem 6.27. From the 


series expansion (6.18), it is easy to deduce that for all x > 0, and alln > 1, 


P a ne 
Ce ee ee a 
2 n! 


In particular, we have 


e >l+qa, 
e>1l+at+ = 
oe 
eS leper a Sa re 
[er ne 
rea da yr 
For « < 0, the series (6.18) is alternating. The sequence {b,,} with b,, = 
me is not decreasing. However, since x2”"-! < 0 and x?” > 0 for all 
n > 1, and e§ > 0 for all £, we can use (6.17) to conclude that for x < 0, 


e >l+da, 


In Theorem 3.37, we apply mean value theorem to prove that | sinz| < |z| for 
all real numbers x. In the following example, we extend this result partially. 
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y 
y 


Figure 6.7: The function f(x) = e” and its Taylor polynomials at x = 0. 


Example 6.31 


fia 


Show that for x € (0,7), sina > a — Te 


Solution 
Let f(z) = sinz. Then f(z) is infinitely differentiable, with the third 
Taylor polynomial at 7 = 0 given by 
x 


7T3(x) =x — 7 


Apply the Lagrange remainder theorem, we find that for any x € (0,7), 
there is a€ € (0,2) C (0,7) so that 


3 (4) 
a if (6) 4 = sing 4 
6 24 24 


sinx — “+ 


Since sin € > 0 for € € (0,77), this proves that 


ae 
sing >&—- —& for x € (0,7). 


We have repeatedly used the fact that if f : J — R is a differentiable function 
defined on an open interval J, and f(a) = 0 for all x € J, then f(a) is a constant 
function. The next theorem extends this result. 
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T(x) 


T(x) 


Figure 6.8: The function f(x) = sin x and its Taylor polynomials at x = 0. 


Theorem 6.37 


Let J be an open interval, and let n be a positive integer. Assume that the 
function f : J — R is (n + 1) times differentiable, and f("*) (x) = 0 for 
all x € I. Then f(x) is a polynomial of degree at most n. 


If f+) (x) = 0 for all x € I, take any point xp in J, and let T,,() be the 
n® Taylor polynomial of f at xo. By definition, f(ao) = T),(ao). Given 
x € I \ {xo}, the Lagrange remainder theorem implies that there is a point 
€ € I such that 


aa® 
(G7) 


n+1 


f(x) — Tr(a) = 


(x — Xo) 


Since f("*)(x) is identically 0, we find that for all x € I, f(x) = T,,(z). 
This proves that f is a polynomial of degree at most n. 


As a corollary, we have the following. 
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Corollary 6.38 


Let J be an open interval, and let n be a positive integer. Assume that 


f:I— Randg: I > Rare (n + 1) times differentiable functions such 
that 


fea) = gt) (a) forall x € J, 


then there is a polynomial p(x) of degree at most n such that 


f(x) = g(x) + p(a). 


Next we turn to the Cauchy remainder theorem. In Example 4.28, we have 


shown that if g : J + Ris acontinuous function, 2p is a point in J, n is a positive 
integer, then the function G : J + R defined by 


Ga [ e-orawae 


mM! Joo 


is (n + 1) times continuously differentiable, 
G(x) = G" (x0) aE G™ (x9) _ 0, 


and 
Gt) (2) = g(x) for all x € I. 
Theorem 6.39 The Cauchy Remainder Formula 


Let J be an open interval that contains the point xo, and let n be a positive 


integer. Given that f : J > Risa function that is (n+1) times continuously 
differentiable, let 
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Then by the result proved in Example 4.28, we find that H is a function that 


is (n + 1) times continuously differentiable, 


JEN) = BU g) = ore = Oa) = 0, 


Ht) (x) = fV(z) = frD(a) = 0 for all x € J. 


By Theorem 6.37 and Corollary 6.33, H(x) = 0 for all x € I. This 
completes the proof of the assertion. 


In Cauchy remainder formula, the error term is expressed as a precise integral, 
although in practice it might not be possible to evaluate such an integral. Let us 
now apply the Cauchy remainder formula to prove that the Maclaurin series of the 
function f(x) = (1 + x)* converges to f(x) when x € (—1, 1). 

Theorem 6.40 


Let a be a real number. For || < 1, 


(ea)? = 


Let f(z) = (1+ 2)*%, —1 < & < 1. We have seen that Ne 
k 


Maclaurin series of f(a). The n™ Taylor polynomial of f(x 
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We need to show that lim T;,(x) = f(x) for all |x| < 1. It is easy to verify 
N—->0o 
that 


F(x) — T(z) = ; (@ =n fp @at 


) fe-aratgerta 


We need to estimate this last integral for « # 0. Making a change of 
variables t = x7, we find that 


‘ 1 
| (x = aa aL. Dem made = ey (1 = r)"(1 “iL tp neh 
0 


Notice that since x € (—1,1), when 7 € [0, 1], 


(l1—7)"(14+ar)-""! > 0. 


For fixed x € (—1,1), the function g : [0,1] > R, g(r) = (1+ 27)*' is 
continuous. Therefore, there is a constant V/ such that 


0<(1+ar)*!1<M for all 7 € [0, 1]. 


This implies that 


t le 
0< | (l—7)"(1+ar)*" 1dr < Mf ( ) cn 
0 ie klar 


For any x € (—1,1) and € (0, 1], 
l+tar>l1—-Tre0. 


This implies that for any x € (—1, 1), 


ee n 
0< ( =| <ul for all 7 € [0,1]. 
1+ 27 
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Therefore, we find that 


Ne 
o< | ( ) disco for all |x| < 1. 
0 I 6 gear 


n+1 


If(x) — T,(x)| cMinti)|(, 9 )e (6.19) 


In Example 6.28, we have proved that the series 2 (*) x" is convergent 
nm 


n=0 
oo 


when |z| < 1. It follows from Theorem 6.21 that the derived series So (n+ 


n=0 


( i JP is also convergent when |x| < 1. This implies that 
n 


a i 
lim in+1)|(, 9) a 


Using squeeze theorem, we deduce from (6.19) that 


him ie cee 


Noo 


This completes the proof. 
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Exercises 6.5 


Question 1 


Let f : R > R be the function defined by 


2—2cosxz 


Question 3 


Show that for all x > 0, 


2D, 


ifx #0, 
ifr =0. 


cee ie 
aa oe 


2 


Question 4 


Show that for all « € (—7,7), 


Dy 


cosx > 1l—-——. 
ms 


2 
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Question 5 


Let a be areal number. Assume that a is not an integer. In Example 6.28, 


(oe) 
we have shown that the power series Ss 


k=0 


({) x", which is the Maclaurin 


series of the function f(x) = (1+ 2)°, has radius of convergence 1. Define 


the function g : (—1,1) -] 


R by 


In this question, you are asked to show that g(x) = (1+2)° for x € (—1,1), 


without using the Cauchy remainder formula. 


(a) Show that (1 + x)g’(x) 


(b) Let h : (—1,1) + Rbe 


(c) Conclude that g(x) = ( 


= ag(x) for all x € (—1, 1). 


the function defined by h(x) = g(x)(14+2)~°. 
Prove that h is a constant function. 


1+ 2)* for all x € (—1,1). 
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6.6 Examples and Applications 


In this section, we discuss some examples and applications. 

The number e and the number 7 are two important numbers in mathematics. 
In Section 6.6.1 and Section 6.6.2, we prove respectively that these two numbers 
are irrational. 

In Section 6.6.3, we prove that there is an infinitely differentiable function 
whose Taylor series at a point does not converge to the function itself. We also 
briefly discuss the applications of such functions, despite its non-analyticity. 

In Section 6.6.4, we construct a continuous function that is differentiable 
nowhere. It uses Theorem 6.9 which says that uniform limit of continuous functions 
is continuous. 

In Section 6.6.5, we prove the Weierstrass approximation theorem, which says 
that any continuous function defined on a closed and bounded interval can be 
uniformly approximated by a polynomial. We give a proof that uses Bernstein’s 
approach. It uses the fact that a continuous function defined on a closed and 
bounded interval is bounded and uniformly continuous. Later when we study 
Fourier series, we are going to prove this important theorem again using the theory 


of Fourier series. 


6.6.1 The Irrationality of e 


In Example 1.36, we have defined the number e as the limit of the increasing 


n 


sequence {a,,}, where a, = (1 +—) . We have proved that a, < 3 for all 
n 


n € Z*. This implies that e < 3. In Theorem 6.27, we proved that 


Theorem 6.41 Irrationality of e 


The number e is irrational. 
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Assume to the contrary that e is rational. Then since e is positive, there are 
positive integers a and b such that 


For any positive integer n, we apply Lagrange remainder theorem to the n™ 
Taylor polynomial of e* at the point 79 = 0. With x = 1, we find that there 
is anumber c,, in the interval (0, 1) such that 

i di Ee 


1 
e=1l+o4+54---4 


Saree 20 
mt 3 al (eel ey 


For n > 6, we find that n! is divisible by b, and so nie is an integer. From 
(6.20), we have 
ee @ 5) 


0 n) n) g 
ie = || lees eee = = 
fs (nt +n 5+ +=) n+l n+l1—n+l1 


Notice that for each 1 < k <n, n!/k! is an integer. Hence, for n > 6, 


n! n! 
nle~ (nl-tnl+ +e +5] 
2! n! 


is a positive integer that is less than 3/(n + 1). For n > 3, 3/n + 1 is less 
than 1. This gives a contradiction. Hence, e must be irrational. 


6.6.2 The Irrationality of 7 


As in the case of the number e, we will show that z is an irrational number using 


proof by contradiction. We begin by two lemmas. 
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Lemma 6.42 


Given that f : R — Rand g : R — R are two infinitely differentiable 
functions. For any n € Z*, and any numbers a and (3, 


B B 
/ FO") (0) g(w)de + i f(a)g2*(x)dex 

gre . a (6.21) 
= S7(-1)F F(B)g2"- (8) — S7(—)* F(a)" (a). 


k=0 


SCD EE (ag? (a) + S(—F (wg h(x) 


k=0 k=0 


Because of the alternating signs, the k = 0 to k = 2n — 1 terms in the first 
sum cancel with the k = 1 to k = 2n terms in the second sum. This gives 


F'(x) = FO") (x) g(x) + f(x)g?"* (2). 


By fundamental theorem of calculus, we find that 


B B 
F(8) — F(a) = | f2"D (0) g(x)dx + / f(a)g2*(w)de. 


This proves (6.21). 
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Lemma 6.43 


Let a, b and n be positive integers. Define the polynomial p : | 


x"(a — ba)” 


n! 


f02 han 1 


: Jaren, We SS 


k-—n 


Since k! is divisible by n! when k > n, we find that p*) (0) is an integer for 


all 0 < k < 2n. Expanding p(x) in powers of (a — a/b), we find that 


ra) = ar (2 9" (") (Ye 


By Lemma 6.32, 
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Comparing the coeficients, we find that 


if O27 — 1, 


Es if ok aon, 


Hence, p‘”)(a/b) is also an integer for all 0 < k < 2n. 


Now we can prove the theorem. 


Theorem 6.44 Irrationality of 7 


The number 7 is irrational. 


Assume that 7 is a rational number. Then there are positive integers a and 
b such that 


For n € Z*, define the polynomial p,,(x) by 


Cas — Joi ena ee 


7) 


n! 


i= || Dre )isin az: 
0 


Take f(z) = pn(x), g(x) = cosz anda = 0, 8 = 7 in Lemma 6.42. Since 
Pn(x) is a polynomial of degree 2n, we find that per) (x) = 0. On the 
other hand, for all k > 0, 


(@k+1) (7) — — sing, 


g@(x) =cosx, 9 


g“*) (2) =—cosa, g@*t3)(x) = sing. 
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In particular, g?"+)) (x) = (—1)""! sin x. From (6.21), we have 


2n 


By Lemma 6.43, p(0) and p (xr) are integers for all 0 < k < 2n. Since 
sin0=0, sint=0, cosO=1, cosr=-l 


are integers, we find that g‘*)(0) and g‘")(z) are integers for all k > 0. The 
right hand side of (6.22) shows that J,, is an integer for all n € Z*. On the 
other hand, for allO0 <a <7, 


O<a(r-—az)< GE 


Therefore, for 0 < x < 7, 


ley on 
OS BAU) SS he 


n! 


Since we also have 0 < sinax < 1 for all 0 < x < 7, we conclude that 


T 2h it 
ei, = | D(a) sum waa, = ue (=) 
0 n! 4 


1b 


[o-e) nm 
: 1 : 
Because the series y a) (=) is convergent, we find that 
OR 
n=0 


Therefore, there is a positive integer NV such that for alln > N, 
ago a! 
mi X A T 


O<it, <1 foralln > N. 


which gives 
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We only need the n = N case now. Since Jy is an integer, we must have 
Iy = 0. However, since 


pn (x) sina 


is a continuous function and it is positive on (0,7), by Example 4.18, 


Iy= | pn(x) sin xdx 
0 


cannot be zero. This gives a contradiction. Hence, 7 must be an irrational 
number. 


6.6.3 Infinitely Differentiable Functions that are Non-Analytic 


We consider the function f : R — R defined by 


1 
exp | = Is if U, 
f(x) = ( 2) 
0, ifx=0. 


We will show that this function is infinitely differentiable and f”)(0) = 0 for all 
n> 0. 


1 
Figure 6.9: The function f(x) = exp (-3). 
ae 


Let us first prove the following lemma. 
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Lemma 6.45 
If p(x) is a polynomial, then 


(6.23a) 


(6.23b) 


In Example 3.24, we have shown that for any real number s, lim y*e ¥ = 
yoo 


0. From this, we find that if & is an integer, 


= wee I] a5 
2 = [tiny 290 gee Pg} | 


These prove (6.23). 


Next, we prove the following. 


Theorem 6.46 


R be the function defined by 


1 
exp {|—— ], Wigicee ole 
»( =) 7 (6.24) 
0, if: 


Then f is an infinitely differentiable function with f)(0) = 0 for all n > 
0. 
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We claim that for each positive integer n, there is a polynomial p,,(x) of 
degree 3n such that 


1 
i} if x £0, 

x 
ifz =0. 


(6.25) 


This will show that f is infinitely differentiable. In fact, Lemma 6.45 
implies that 


Lion f(t) = lim pp (=) exp (-3) =0= f@), 


x0 n—0 


which says that f‘”)(a) is continuous at 2 = 0. We will prove (6.25) by 
induction on n. When n = 1, we find from the definition (6.24) that 


when x # 0. 


When x = 0, we apply Lemma 6.45 to get 


ea, 
SO) | oe | 
f'(0) = lim = 


x0 G 


Therefore, the n = 1 statement is true with p(x) is polynomial of degree 3 
given by 
joka) 


Assume that the statement is true for the n — 1 case. This means that there 
is a polynomial p,_1(x) of degree 3n — 3 such that 


sles) 
= expe Ie 
x x 


When x # 0, 
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This shows that when x # 0, 


where 


Pr(t) = —2°p,_y (2) + 20"Pn1 (2). 


By inductive hypothesis, p’,_ (x) is a polynomial of degree 3n — 4. Thus, 
x*p!_,(x) is a polynomial of degree 3n — 2. Since 2x%p,_1(x) is a 
polynomial of degree 3n, p,(x) is a polynomial of degree 3n. For the 
derivative at 0, Lemma 6.45 implies that 


(Osim Ge Oe, )ex 


x0 ae 


This proves the statement for the n case, and thus completes the induction. 


Now we prove our main theorem in this section. 


Theorem 6.47 


Let J be an open interval that contains the point x9. There is an infinitely 


differentiable function f : J + R whose Taylor series at the point x = x 


is convergent pointwise on J, but it does not converge to f(x) pointwise on 
ie 


Define the function f : J > R by 


oor 


0, 


Theorem 6.46 implies that the function f(z) is infinitely differentiable on 
I, and f) (xo) = 0 for all n > 0. Hence, the Taylor series of f at x = 20, 
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is the series that is identically 0. Therefore, it converges everywhere, but it 
does not converge to f(x) except at the point x = Zp. 


Using almost the same proof as for Theorem 6.46, we obtain the following. 


Theorem 6.48 


Given a real number 2p, the function g : R — R defined by 


1 
exp (- ) : ie = 5 
xr — Xo 


0, if & < Xp. 


is infinitely differentiable. 


The function g(x) defined by (6.26) is also not analytic. Nevertheless, it has 
some important applications. It is usually used to "smooth" up a function or 


truncate a function smoothly. 


Theorem 6.49 


Given two real numbers a and b with a < b, define the function h : 


Then / is a functon that is infinitely differentiable. 
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We just need to show that g(x — a) + g(b — x) is nonzero for all x € R. 
The rest follows from Theorem 6.48 and the definition of h(x). Since the 
function g is nonnegative, in order for g(x — a) + g(b — x) = 0, we must 
have g(a — a) = g(b — x) = 0. But we know that g(x — a) = 0 only when 


x <a, and g(b— x) = 0 only when x > b. Since the set {x |x < a} and 


the set {x|x > b} are disjoint, we conclude that g(x — a) + g(b — x) is 


never 0. 


Figure 6.10: The function g(a) defined by (6.26) when x9 = 0. 


Figure 6.11: The function h(x) defined by (6.27). 


Remark 6.4 
The function h(x) defined by (6.27) is an example of an infinitely 


diferentiable function that is increasing but assume constant values outside 


a bounded interval. 
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6.6.4 A Continuous Function that is Nowhere Differentiable 


In this section, we want to construct a continuous function f : R — R which is 
not differentiable at any point. The main ingredient in the proof is to note that the 


function g : R > R, g(x) = |z| is continuous, and it is not differentiable at x = 0. 


Definition 6.15 The function h,, 


For any positive number m, let h,,, : R — R be the function defined by 


a) ap forall —-m<a<m, 


Filo 2) — 0) forallz €R. 


Figure 6.12: The functions h,,(2) when m = 1, } and . 


Let us first explore the properties of the function h,,,,. 


Lemma 6.50 


Given a positive number m, define z,,., = mk for all k € Z*. The function 
h,, defined in Definition 6.15 has the following properties. 


(a) hy» is a continuous even function that is periodic of period 2m. 


(b) For & € Z, the graph of Ay, : [%m.2x;%m 2x41] 3 R is a straightline 


segment of slope 1; while the graph of hy, : [%m2x-1,%m,2x] > Risa 


straightline segment of slope —1. Hence, the graph of h,,, is a union of 
straightline segments alternatingly having slopes 1 and —1. 


(c) O<hp»(x) < m for all z ER. 
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Part (a) follows from h,,(—m) = h»(m). Part (b) can be proved by 
induction on k > OQ, using the periodicity of h,, and the fact that h,,, is 
an even function. Part (c) follows from the definition of h,,, and periodicity. 


Lemma 6.51 


Given a positive number ¢ and a point x € R, let 


U = |e 2/2. | and V [ee 2. 


For a positive integer m, let h,, : R — R be the function defined in 
Definition 6.15. Then one of the following holds. 


(a) For each nonnegative integer k, the graph of hax, : U > Ris a line 
segment of slope 1 or —1. 


(b) For each nonnegative integer k, the graph of hoax, : V > R is a line 
segment of slope 1 or —1. 


The points nf, n € Z, partition the real line into subintervals of the form 


[n£,(n + 1)é], each of length @. Since U and V are adjacent intervals of 


length ¢/2, one of them must lie entirely inside one of the intervals of the 
form [né, (n + 1)4]. 

By part (b) in Lemma 6.50, the graph of hy : [né,(n + 1)4) > Risa line 
segment of slope 1 or —1. This proves the assertion when k; = 0. To prove 


the assertion for k > 1, we notice that to obtain the graph of the function hy, 
from the graph of the function h2,, we divide each line segment in the graph 
of hz into two equal parts, one of the parts change slope from 1 to —1 or 


from —1 to 1. Hence, if W is an interval and the graph of hy : W — R is 


a line segment, the graph of hax, : W — R must also be a line segment for 
any k € Z*. This completes the proof the the lemma. 


Now we can prove the main theorem in this section. 
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Theorem 6.52 


For a positive number m, let h,,, : R — R be the function 


Am(x) = |x| for |z|<m, and h(x+2m) = A(z) forall x ER. 


For n > 0, let g, : R — R be the function defined by g,(z) = hm, (2), 


: 1 ine 
with m,, = in Then the series Ss gn(x) converges uniformly to a function 


n=0 


f:ROR, 


f(x) = So ono). 


f(x) is a continuous function that is not differentiable at any point. 


By Lemma 6.50, for each n € Z*, the function g,, : R is continuous 
and 


for all x € 


Since the series yy TE is convergent, Weierstrass /-test implies that 


n=0 


the series SS gn(x) converges uniformly on R. Since each g,,(x) is a 


n=0 


continuous function, Corollary 6.10 implies that the function f(x) = 


(oe) 
y gn(x) is continuous. 
n=0 


Now we are left to prove that f(x) is not diferentiable at any x € R. Given 


xo € R, assume that 


exists. Then for any sequence {x,}?°9 in 
the limit 


exists and is equal to f’(29). 
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We construt a sequence {x;,}?°.9 as follows. For each k € Z*, Lemma 6.51 


implies that either the graph of h,,,, : [wo — mz/2, x20] > R or the graph of 


h : [%o, to +m,/2] — Ris a line segment with slope 1 or —1. In the former 


case, we let x, = Xp — m,/2. In the latter case, we let x, = 9 + m,/2. In 
any case, we find that 
Mk 1 


el eee for all k > 0. 


This shows that {x,} is a sequence in R \ {xo} that converges to xo. 
For fixed k € Zt, m,/2 is a multiple of 2m, for alln > k+ 1. By 
periodicity of hy, 


One) — Gr 25) — le ( ane ae = for all n > k. 


This implies that 


f(%x) — F (xo) = S Gn(Lk) — Gr(£o) 


Le — Xo Le — Xo 


n=0 


By the definition of x, and Lemma 6.51, 


Gn( Zk) = Gn( Zo) 
Le — XO 


is equal to 1 or —1 for each 0 < k < n. The sum of an odd number of 1 
or —1 must be odd. The sum of an even number of | or —1 must be even. 
Therefore, 
= f (xx) — F (x0) 
LE — Lo 

is odd when k is even, and is even when & is odd. This implies that the 
sequence {c;,}?° is an integer sequence that is alternatingly odd and even. 
Hence, it does not have a limit. This is a contradiction, which allows us to 
conclude that f cannot be differentiable at xo. 
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Figure 6.13: The functions g,(x) for n = 0,1, 2,3, and the function f(x). 


6.6.5 The Weierstrass Approximation Theorem 


In this section, we prove the Weierstrass approximation theorem using Bernstein’s 
ingenious approach. We start with a lemma. 


Lemma 6.53 
The following identities hold. 


(a) Forn > 0, > (") a*(1 —2)"* = 1. 
k=0 


(b) Forn > 1, )> = (") a*(1—2)"* = 2. 
Ra] 


i 2 
(c) For n > 2, y as (;) roel _ Se = 7? + 
n 
k=1 


n i 2 
(d) Forn> 2, (2— =) ( 


k=0 


The first identity (a) is just a consequence of the binomial expansion 


theorem. 
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For the identity in (b), notice that when n > k > 1, 


=(i] ~ (k aa kyl é i" a) 


Therefore, 


For part (c), we find that when n > k > 2, 


io (n — 2)! 
) (k= 2)\(n — ky! 


way, ed a= 2 


k=0 


Writing k? = k(k — 1) +k, we have 


"kn ‘ ‘ 
es fais 
=i, 25 


"k(k—-1)(n\ , -# 
= —_—___——. | = Ww 
ye 7 (;,)2 (l-—a2)* "+ 
n n 


For the identity in part (d), a straightforward computation gives 


ata Sy 


a 5) ie a*(1—a)r-* 


HACE 
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Definition 6.16 Bernstein Basis Polynomials 


For any positive integer n, there are n+ 1 Bernstein basis polynomials given 


Pnk(@) = G) a1 — x)P-*, 


by 


Figure 6.14: The polynomials p,,(x) = @ a*(1 — x)"-* when n = 2 and 
n= 3,forallO0<k<n. 


me SS 


n=5 


Figure 6.15: The polynomials p,,(x) = @ a*(1 — 2)"-* when n = 4 and 
n=5,foralO<k<n. 


Now we come to our main theorem. 
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mS 


n=6 


Figure 6.16: The polynomials p,,,(a) = @ a*(1 — x)"-* when n = 6 and 
n=7,foralO0<k<n. 


Theorem 6.54 Weierstrass Approximation Theorem 


Let f : [a,b] + R be a continuous function defined on |a, b]. Given e > 0, 
there is a polynomial p(x) such that 


f(x) — p(x)| <e for all x € [a, O). 


We first consider the case where [a,b] = [0,1]. Since f : [0,1] > Ris 
continuous on a closed and bounded interval, it is uniformly continuous 


and bounded. The boundeness of f implies that there is a positive number 
M such that 
|f(v)| <M forall x € [0,1]. 


Given € > 0, since f is uniformly continuous, there is a 6 > 0 such that for 
all x, and x2 in (0, 1], if |x; — r2| < 6, then 


\F(a1) — F(a2)| < 5. 


For any positive integer n, we construct a polynomial p,,(xz) to be a 
polynomial of degree at most n given by the following linear combination 
of Bernstein basis polynomials. 
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pr(z) = ys (=) Ponte) = x r(E) (Mora -ayn# 


Let us estimate the supremum of | f(a) — pp(x)| on [0,1]. For fixed x € 
[0, 1], part (a) in Lemma 6.53 implies that 


f(z) - pala) => ( r@)- 5 ()) (f \eta- ay 


k=0 


Since x*(1 — x)"-* > 0 for all x € [0,1] and alln > k > O, triangle 
inequality gives 


(2) ~ pal) S| 102)~ J (=)| ()at —ay* 


k 
For0<k<n,if r- 5] < 6, then 
n 


Therefore, 


f(x) — palx)| < So 


k=0 


By Lemma 6.53, and the fact that 


0<a(1-2z) 
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we find that 


BO 20 
M M 
Ifn = 762’ then 252 < =. For any such n, we find that 
es) ee lee)ll| ae toralliOs, << 


This completes the proof when |a, b] = [0, 1]. 


For general [a,b], let u : [0,1] — R be the polynomial function u(t) = 


a-+t(b—a). This is a continuous function mapping |0, 1] bijectively onto 


: : : ‘ t— a : 
[a, b]. The inverse is the continuous function u~!(x) = = The function 
—a 


g = fou: [0,1] > R, being a composition of continuous functions, 


is continuous. By what we have proved above, given ¢ > 0, there is a 
polynomial q(t) so that 


|f(u(t)) — g(t)| <e for all t € [0, 1]. 


Then p(x) is also a polynomial, and p(u(t)) = q(t). Therefore, 
| f(u(t)) — p(u(t))| <e€ for all t € [0, 1], 
which implies that 
|f(x) — p(a)| <e for all x € [a, 8). 


This completes the proof of the Weierstrass approximation theorem for the 
general case. 


One cannot extend the Weierstrass approximation theorem to the case where 


f : I — Risa continuous function defined on an unbounded interval J. This is 


because a non-constant polynomial would approach oo or —oo when x approaches 
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y= f(x) 


Figure 6.17: Approximations of the continuous function f(z) by the polynomials 
Pn(x), where f(x) = 3sin(4a|xz — 1/3]) + 2sin(6a|z — 3/4]). 


oo or —oo. However, there are bounded continuous functions defined on unbounded 


intervals. For example, the function 


is a bounded continuous function defined on R. 


Remark 6.5 


In probability theory, a binomial random variable X with parameters n and 
p counts the number of successes in n independent and identical Bernoulli 
trials, each has a probability p € (0,1) of being a success. X can take 
integer values between 0 and n. The probability that X = k is 


(j,)ora =p) Waka 


The identity in (a) of Lemma 6.53 amounts to 


¥ (7) eta - 


k=0 
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which reflects that the total probability is 1. The identity in part (b) gives 


E(X) = 5 K(; ont — p)* = np, 


which is the expected value of a binomial random variable X with 
parameters n and p. The identity in part (c) gives 


EOC?) = S08 @ic — p)* = np" + np(1 — p). 


Together with the identity in part (b), the variance of X is given by 
Var (X) = E(X*) — E(X)? = n?p? + np(1 — p) — n*p* = np(1 — p). 
In fact, the variance of a random variable X is defined as 
Var (X) = E([X — E(X)]*). 


The identity in part (d) of Lemma 6.53 is just another way of computing 
the variance. Using part (d), we have 


5 i(k — np)? @i —p)* 


k=0 


= Ss (- -») Gi — p)* = np(1— p). 
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